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Abstract. We consider a class of stochastic dynamical systems, called piecewise deter- 
ministic Markov processes, with states (x, a) 6 x T, Q being a region in R d or the 
d-dimensional torus, F being a finite set. The continuous variable x follows a piecewise 
deterministic dynamics, the discrete variable a evolves by a stochastic jump dynamics 
and the two resulting evolutions are fully-coupled. We study stationarity, reversibility 
and time-reversal symmetries of the process. Increasing the frequency of the cr-jumps, 
we show that the system behaves asymptotically as deterministic and we investigate the 
structure of fluctuations (i.e. deviations from the asymptotic behavior), recovering in 
a non Markovian frame results obtained by Bertini et al. [T] |3] H], in the context 
of Markovian stochastic interacting particle systems. Finally, we discuss a Gallavotti- 
Cohen-type symmetry relation with involution map different from time-reversal. For 
several examples the above results are recovered by explicit computations. 

Key words: Non-equilibrium Processes, Large Deviations, Stationary States. 

1. Introduction 

Piecewise deterministic Markov processes (PDMPs) are stochastic dynamical systems 
whose state is described by a pair (x,a), where x is a continuous variable and a is a 
discrete variable. We take x G and a S T, £l being a region in M. d or the d-dimensional 
torus, r being a finite set. Motivated by applications to biochemical processes [13] , we call 
x and a the mechanical and the chemical variable (or state) of the system, respectively. 
The chemical state a evolves by a random jump dynamics, while in the intervals in which 
the chemical state is kept constant and equal to some a, the mechanical state x evolves 
according to the deterministic cr-dependent ODE x(t) = F a (x(t)). Since the probability 
rates of chemical jumps can depend on x, the mechanical state x and the chemical one a 
are dynamically fully-coupled. In our analysis, we restrict to time-homogeneous PDMPs, 
i.e. both the vector fields F a {x) and the probability rate Ar(cr, cr'\x) for a chemical jump 
from a to a' at the x-mechanical state are time-independent. Above, A is a positive 
parameter we will play with in order to analyze some special regime. The above models 
can be used to describe the overdamped motion of a particle in a viscous fluid under 
alternating force fields, as well as some biochemical processes as discussed in [13J 

PDMPs are broadly used in applied sciences and engineering, and are a typical example 
of what is called a stochastic hydrid system in control theory [8] . A mathematical analysis 
of PDMPs has been started by Davies in [9] and the interested reader can find a detailed 
mathematical treatment in [TO] . Our interest here is mainly theoretical and inspired by the 
physics of out-of-equilibrium systems. In particular, our investigation concerns the steady 
state, the time-reversed process, the deviations of the system from its typical behavior, a 
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special fluctuation-dissipation relation and a Gallavotti-Cohen-type symmetry relation. 
We discuss our results in more detail. 

In general, under mixing assumptions, the steady state (stationary measure) is unique 
and has density p\(x,a) on O x T which solves a system of differential equations with 
zero-flux boundary conditions. We give exact solutions in dimension one, while for any 
dimension we isolate a class of exactly solvable models for which p\ has the special form 

p x (x,a) = c(X)e- xs ^p(x,a), (1.1) 

where c(A) is a normalization factor depending only on A. Given the stationary measure 
px, we consider the time-reversed (adjoint) version of the PDMP and we show that it 
is again a PDMP, with inverted vector fields and transition rates Ar + which depend on 
the direct rates r and on the stationary measure p\. In particular, our PDMPs typically 
describe out-of-equilibrium systems, since reversibility appears only in the trivial case of 
vanishing force fields. For exactly solvable models as in (jl.l|) . we can show that r + (-, -\x) 
does not depend on A as well some symmetry relations. 

In order to study the deviations of the system from its relaxation to equilibrium, we 
introduce a scaling procedure forcing the system to behave deterministically in the asymp- 
totic limit. Simply, we take the limit A f oo. As result, the timescale of chemical jumps 
becomes infinitesimal w.r.t. the timescale of the mechanical evolution and the dynamics 
is a combination of slow and fast motions. As one would expect, an averaging principle 
holds: the slow motion is well approximated by averaging the effect of the fast motion, 
considering the fast (chemical) variable as locally equilibrated. In order to be more precise, 
let us assume that for any the continuous-time Markov chain on T with jump rates 

r(-,-\x) (x being interpreted as frozen variable) is irreducible and therefore has a unique 
invariant probability measure n{-\x) on V. Then the above high frequency limit implies 
that, whenever the mechanical state of the PDMP is x, the chemical state is given by 
a with probability well approximated by p(a\x), while with probability tending to 1 the 
mechanical evolution x(t) is well approximated by the deterministic path x*(-) solving the 
Cauchy system 

±„(t)=F(x„(i)), 

2C*(0) = X , 

xq being the initial mechanical state and F being the averaged vector field 

F{x) = y ^p J {a\x)F (T {x). 

<rer 

The above averaging principle corresponds to a law of large numbers for the mechanical 
evolution and, introducing suitable spaces and topologies, it can be extended to the joint 
evolution (x(i),<r(i)) (see Section [6]). A rigorous derivation of the averaging principle as 
well as the large deviations (LD) principle for PDMPs can be found in the companion 
paper [T2] . 

Considering the chemical variable as hidden and taking the limit A | oo, we analyze 
the structure of fluctuations of the mechanical variable, i.e. deviations from its asymptotic 
deterministic behavior (|1.2|) . following ideas and results of [U El E], for stochastic in- 
teracting particle systems. A key identity observed in [2] is the Fluctuation-Dissipation 
(FD) relation 

C(x,x) = W(x) -x + £ + {x,-x), (1.3) 
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where V denotes the static LD functional of the steady state (in exactly solvable models 
as in (11. ip . V = S), while C and C + are such that the LD functionals for the dynamics of 
the PDMP and its time-reversed version are obtained by integrating along the mechanical 
trajectories x(t) the functions C(x, x) and C + (x, x), respectively. As observed in [HEJEJII] 
and recalled in Section [71 whenever the FD relation is satisfied, several physical properties 
concerning the relaxation of the system hold. In [2] the authors derive the above FD 
relation from the definition of the time-reversed process and from the Markov property 
of the processes under considerations (the direct one and the time-reversed one). In our 
case, the mechanical evolution x(t) is typically non Markovian, hence the validity of the 
FD relation has to be investigated. When the dependence on the parameter A of the 
transition rates Xr + is linear or almost linear, as in the case of ID system or in the case of 
exactly solvable model with stationary measure (jl.ip , we can apply again our LD principle 
for A-rescaled PDMPs. Then, we show the validity of the FD relation for the entire class 
of solvable PDMPs whose stationary measures satisfies (jl.ip as well for PDMPs with two 
chemical states on the one dimensional torus for which the stationary measure is not of 
the form (fL~T|) . 

We briefly discuss a Gallavotti-Cohen-type symmetry relation for PDMPs. The natural 
symmetry for this class of processes is different from time-reversal and the corresponding 
action functional has a direct physical interpretation. We obtain in this way examples 
answering a question raised at the end of Subsection (2.2) in [T7J. See also [18] and [IB] 
for more details and references on the Gallavotti-Cohen symmetry in the framework of 
stochastic dynamics. 

The paper is structured as follows. In Section [2] we give a detailed description of the 
model and comment our basic assumptions. In Section [3] we discuss stationarity and 
reversibility, giving a system of differential equations with boundary conditions character- 
izing the stationary measure and showing that the adjoint process is again a PDMP. In 
Section we compute the stationary measure for a class of ID PDMPs, which in many 
cases has the special form (jl.ip . In Section [5] we outline a general method valid in all 
dimensions in order to determine stationary measures of the form (jl.ip . and we apply it 
in several examples. In Section [6j we recall the averaging and large deviation principles 
obtained in [12]. Having at this point all the necessary tools, in Section [7J we study the 
statical and dynamical deviations of the system from its typical behavior in the same 
spirit of the fluctuation theory developed in [H El El E] . Finally, in Section [8] we study a 
Gallavotti-Cohen-type symmetry relation. 

We conclude with a remark. Being stochastic dynamical systems, PDMPs can have very 
different behaviors and show special features. When possible we have tried to keep our 
analysis at a general level, thus requiring some mathematical abstraction. On the other 
hand, special dynamical mechanisms have been discussed directly by means of examples. 
Moreover, even in very simple examples standard stochastic tools used in the paper as the 
Markov generator can become very delicate and subtle. The interested reader can find 
some insights in the appendix and can refer to [lOj for a general theory. 

2. The model 

We consider stochastic models with state space Q x T, where T is a finite set and f2 is 
either a domain (i.e. open and connected subset) of M. d with regular boundary <9S7, or the 
closure of a domain of M. d with regular boundary, or the (i-dimensional torus M. d fZ d . A 
generic element of the state space is denoted by (x, a). Inspired by power-stroke models 
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of molecular motors, we call the variables x E £1 and a E T the mechanical state and 
the chemical state of the system, respectively. Their joint stochastic evolution can be 
described as follows. The mechanical state x evolves continuously, while the chemical 
state a jumps at random times. When the chemical state is a, the mechanical state 
evolves according to the ordinary differential equation 

x(t) = F a (x(t)), (2.1) 

where, for any a E T, F a {x) = (F a ^i(x), . . . ,F a ^{x)) E M. d is a vector field. If Q is the 
d-dimensional torus, in the above equation x is thought of as element of a box in 
with periodic boundary conditions. We assume that the vector fields F a have continuous 
extension to the closure f2 and satisfy the Lipschitz condition 

\F a (x) - F a (y)\ ^ K a \x - y\, Vz,yEO, (2.2) 

for appropriate constants K a . Moreover, we assume that the mechanical evolution remains 
confined inside the region 0. This assumption together with (12. 2p implies existence and 
uniqueness of the mechanical trajectory. 

The chemical state a performs a jump stochastic dynamics with rates depending on 
the mechanical state. More precisely, the jump rates are continuous functions r(a,a'\x) : 
r x r x £1 — > [0, oo). Without loss of generality we assume that 

r(a,a\x) = 0, V(x, a) E O x V . 

Moreover, we call 7(cr|x) = ^2 a / € ^r(a,a'\x). Given the initial state (xo,ao) £ fl x T, we 
consider the random variable T\ with distribution 



(ri > t) 



1 t < 0. 



In the above formula A is a positive parameter and xq(s) is the solution of the Cauchy 
problem 

x(t) =F ao (x(t)), 



x(0) = xo ■ (2-3) 

The evolution of the system (mechanical state and chemical state) in the time interval 
[0,7~i) is given by (xo(s), Co). The chemical state (t{t\) is then chosen in V according to 
the distribution 

w = ') = ! Tfnr' 

j{a \x{Ti)) 

Let xi(t), t ^ ri, be the solution of (|2.3p for the vector field i^ CT ( n ) and initial condition 
xi(t~i) = Xq(ti). Let T2 be a random variable distributed according to 



P(r 2 > t) 



e ~ A /r 1 7(o-(ti) \xi (s))ds t> Tl 



l t<n. 

The evolution of the system in the time interval [t\,T2) is given by (xi(s), a{ji)). The 
chemical state a{T2) is chosen in V according to the distribution 

p / / x \ r(^(ri),q|x(r 2 )) 
F(a(r 2 ) = a) = — , 
1{o-{ti)\x{t 2 )) 

and so on. In general, we denote by the random time of the fc-th chemical jump and 
by (a>fc(s), c( r fc)) the state of the system at time s E [ri,%i). We have that Xk(s) solves 
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(|2.3|) for the vector field F a ^ with initial condition Xk{rk) '■= Xfc_i(Tfe) and that Tk+i is 
a random variable with distribution 

p(Tfc+i>t) = r ^ fc ' (2.4) 

The chemical state a(Tk+i) is then chosen in T according to the distribution 

p/ / x x r(a(r fc ),a|x(r fc+1 )) 

F(<T(r fc+ iJ = crj = — -— . 

7(fj(r fc )|x(r fe+1 )) 

In order to have a well-defined dynamics for all positive times we require that a.s. the 
family of jump times has no accumulation point. This is always true if hnifcjoo = +oo 
a.s. 

The natural path space of the process (x(-), cr(-)) is given by the cartesian product 

C([0,T],O) xD([0,T],T). (2.5) 

The first component is the space of continuous functions from [0, T] to f2, while the second 
component is the Skorokhod space of functions from [0, T] to T, which are right contin- 
uous and have left limits. We note that, due to relation (|2,ip . the mechanical trajectory 
{x(t)} t£ [ T j is a piecewise differentiable function and it holds 

x(s) = F a(s) (x(s)) , (2.6) 

for any s £ [0, T] where {<r(t)} i6 [o is continuous. 

The above stochastic process (x(-), cr(-)) is called Piecewise Deterministic Markov Pro- 
cess (PDMP) [9], |10j . In control theory, it is a typical example of stochastic hybrid system 
[8]. Although the evolution of the mechanical state as well the evolution of the chemical 
state are not Markovian, as proven in [9], [10] the joint evolution (x(-),c(-)) is a strong 
Markov process, whose Markov generator is formally 

Lf(x, a) = F a (x) ■ V/(x, a) + A ]T r(a, a'\x) (f(x, a') - f{x, a)) (2.7) 

o-'er 

where / : O x V —> M is regular in the mechanical variable x. In Appendix [A] we will specify 
the precise meaning and domain of the operator L. For any fixed if!!, the x-dependent 
Markov generator L c [x] on T given by 

L c [x}f(a) = ^ r(a, o*\x) (f(a') - f(a)) (2.8) 

is called the chemical part of the generator L. Hence, we can write 

Lf(x, a) = F a (x) ■ V/(x, a) + XL c [x]f(x, a). 

Note that L c [x] is the Markov generator of a continuous-time Markov chain on T where 
jumps from a to a' take place with probability rate r(o~, a'\x). We will assume that for any 
fixed x G O, this Markov chain is irreducible and consequently has a unique stationary 
measure fi(-\x), that we call quasistationary measure. In the particular case of two chemical 
states, e.g. T = {0, 1}, this condition reduces to the positivity of the rates r(0, l\x) and 
r(l,0\x). In this case, the quasistationary measure is also reversible w.r.t. the Markov 
chain on T with generator L c [x] and is given by 

. , , r(l,0|x) , , , r(0, l\x) 

u O i ) = —, 1 \ / — r^, u(0 x) = — -V ; — r^r- 2.9) 

PV 1 ' r(0,l|x) +r(l,0a?) ^ KlJ r(0, l\x) + r(l, 0\x) K ' 
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Let us now come back to our assumptions and give some comments. As already stated, 
in order to have a well-defined dynamics for all positive times we require that a.s. the 
family of random jump times t\~ has no accumulation point. This fact is implied for 
example by the condition 

sup max "y(ct\x) < oo . (2-10) 

Indeed, calling C the l.h.s. of (f2"T0l) . due to CUD we get that P(r fe+1 - r k > t) ^ e - cxt . 
This allows to build a coupling between the family of random jump times r/% and a Poisson 
point process (PPP) on (0, oo) with density CX such that all jump times belong to 
the PPP. Since a.s. the PPP has no accumulation point, the same property holds for the 
family of jump times and this proves our claim. Let us also point out that, due to the 
above coupling, we get that the random variable Nt given by the number of jump times 
Tfc in the time interval [0, t] has finite expectation. 

One can even weaken condition (|2.10p . Due to the irreducibility assumption for L c [x], 
the absence of accumulation points for the family of jump times Tt is implied by the 
condition 

sup min 7(<t|x) < +oo (2-11) 
{seO}{ <T6r } 

and some other additional assumptions. Without trying to give some general criterion, in 
order to explain the mechanism we have in mind we discuss in Appendix [B] an example 
where (|2.1ip is valid and (I2.10|) is violated, while the family of jump times has no 
accumulation point. 

As already stated, we assume that the mechanical trajectory x(t) remains confined inside 
O. If 0, is the d-dimensional torus, this assumption is trivially satisfied. Let us consider 
the case Q C M. d . Then, it is necessary that there is zero flux through the boundary. A 
sufficient condition is given by 

F a (x) ■ n{x) ^ 0, V<7 G T, x G dVt , (2.12) 

where • denotes the Euclidean scalar product in M. d , while n(x) denotes the outward normal 
to dQ. If 0, includes its boundary dQ, the above condition is enough to have confinement, 
otherwise one can require in addition to (|2.12p that 

F a (x) = \/x G d£l s.t. F a (x) ■ n(x) = . (2.13) 

This condition excludes the presence of orbits tangent to the boundary at some point. 

Another condition assuring the confinement of x(t) is the following. We take C M. d 
open for simplicity. For any a G T and xq G dQ, consider the trajectory x(t) starting in 
xq with reversed vector field — F a (x), namely x(t) = —F a (x(t)). If this trajectory is well 
defined in some time interval [0, to) such that x(t) G SI for all t G (0, to), then we require 
that 

to 

j(a\x(s))ds = +oo . (2.14) 

We claim that the mechanical evolution is kept bounded inside by a stochastic mech- 
anism. In fact, condition (|2. 14[) guarantees that if the mechanical trajectory is pointing 
towards xo, with probability one there is a jump to a new chemical state before reaching 
xo- Now again, if the mechanical trajectory associated to the new chemical state is point- 
ing towards a point x\ G <9S7, with probability one there is a jump to a new chemical state 
before reaching x\. In order to reach the boundary d£l in a finite time, the system should 
perform infinite chemical jumps in that time interval, which is not possible due to our 
assumptions. In the examples discussed below, the above two criteria for the mechanical 
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confinement inside open ft's are dual: if the system is confined due to (I2.12|) and (|2.13j) . 
the time-reversed system will be confined due to (|2.14p . 

We will mainly be interested in models such that a.s. the family of random jumps times 
Tfc is infinite. A sufficient condition to obtain this behavior is given by 

inf min y(o~\x) > 0. (2.15) 

In fact, with arguments similar to the ones after (I2.10p . it can be shown that the family 
of jump times dominates a PPP. We discuss in Appendix [O an example of a PDMP that 
violates (12.150 and has finite number of chemical jumps. 

Finally we remark that if there exists x* G ft such that F a (x*) = for any a 6 T, then 
the PDMP with initial condition x(0) = x* has a trivial behavior: the mechanical variable 
does not evolve, while the chemical variable evolves as a continuous-time Markov chain 
with transition rates r{a,a'\x*). 

We conclude this section with some notation frequently used below. Given a point 
(x, a) £ ft x T, we denote by F% a and a the law of the process (x(-),c(-)) starting in 
(x, a) and the associated expectation, respectively. 

3. STATIONARITY AND REVERSIBILITY 

A probability measure p\ on ft x V is called invariant, or stationary, if for any time 
t ^ the pair (x(t),o~(t)) is distributed according to p\ when the process has initial 
distribution p\. In this case, the process starting with distribution p\ is called stationary. 
Since the dynamics is defined by time-independent rules, this implies that for each t ^ 
the laws of the trajectory |x(s), cr(s)} s > Q and the law of the time-shifted trajectory 

{x(s + t),a(s + i)} >Q coincide. This observation together with Kolmogorov Theorem 
allows to univocally extend the process for all times t 6 R, by requiring that its law does 
not change under time-shifts. Below, when referring to a stationary process we will often 
mean the M-extended one. In particular, if the process is stationary we can define its 
time-reversed version. To this aim, we introduce the time-reversal operator, defined as 

T[{x(t),a(t)} tm ] : ={ x (-t),a(-t)} tm . (3.1) 

Since we want T to be an operator from and onto the path space C(R, ft) x D(K, T), 
the above definition has to be slightly modified by replacing the r.h.s. of (|3.ip with 
the only path in C(R, ft) x Z)(R,r) coinciding with {x(— t), o~(— £)} tg R a t an continuity 
points t. For the sake of simplicity, when writing the r.h.s. of (|3.ip we will mean this 
last path. Then the time-reversed process (also called adjoint process) is defined as the 
process obtained from the original one via T. If P^ A is the law of the original process, 

then Pp^ + := Pp A o T _1 is the law of the time-reversed process. If the two laws coincide, 
one says that the process with law P^ A is reversible and that p\ is a reversible measure for 
the process. As we will explain below, the time-reversed process is again a PDMP. Due 
to the Markov property, by considering the transition probability kernels of Pp^ + , one can 
easily define the adjoint process with arbitrary initial distribution v. We will denote P^' + 
its law on C(R + ,ft) x D(R+,T). 

Existence and uniqueness of the stationary measure of a PDMP can be non trivial and 
the analysis can be very model-dependent. If ft is bounded one can deduce the existence of 
a stationary measure as follows. Fixed any initial distribution v, we write v s for the law of 
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(x(s),a(s)) under P*. By compactness arguments (cf. [6]), the family of Cesaro averages 
v t := t" 1 J Q v s ds admits a subsequence D tn , with t n f do, converging to some probability 
measure on O x T . If is closed or if $7 is open and i/*(5f2) = 0, then by standard 
arguments one can show that v* is a stationary probability measure for the PDMP. The 
fact that is*(dft) = for C M. d can be verified for example if, when approaching the 
boundary, the system typically jumps to a chemical state a with a vector field F a of order 
one pointing inside f2. We will come back to this mechanism in Appendix [B] Other 
existence criteria are given in [lOj . 

In the rest of this section we restrict to the case of C M. d open or Q being a d— 
dimensional torus. Assuming now the existence of some stationary measure p\, we want 
to give a characterization of p\ by means of partial differential equations. Due to Theorem 
34.19 in [10], if p\ is a stationary measure then it must be 

p x (Lf) = (3.2) 

for a large class of functions / in the domain of the extended generator (see Appendix 
lAl for the definition of extended generator) and in particular for functions / which are 
bounded and C 1 in x. Let us denote here by F the family of functions / which are C 1 
in x, have continuous extension to dO, and satisfy for some a the property: f(x,a') = 
if a' ^ a. Assuming p\ = ^ CT p\(x, a)dx5 a (i.e. p\ is absolutely continuous w.r.t. the 
Lebesgue measure on each subspace Q x {a}) and assuming that p\(-,a) is C , equation 
IB for / e F reads 



/ dx p x (x,a)F a (x)-Vf(x,a)+\^2 / dxf(x, a) (p\(x, (j')r(cr', a)-p x (x, a)r(a, a')) = . 

(3.3) 



'er 

By the Gauss-Green formula, the first integral in the l.h.s. equals 



dS(x)f(x,a)p\(x,a)F a (x)-n(x)- dxf(x, <r)V • (p\(x, a)F a (x)) , (3.4) 
an Jn 

where dS denotes the (d — 1) -dimensional surface measure on d£l and n(x) denotes the 
outward normal to 90 in x. Since ()3.3p must hold in particular for all functions / € F 
with x-support given by a compact subset of 0, we conclude that 



A (^( x > a ') r ( a> > a \ x ) ~ Px( x i a ) r (^ a '\ x )) = v • [Px(x, a)F a (x)j, V(x, a) <EttxT 



a'er 

(3.5) 

Then, due to (|3.3p . (13. 4|) and (j3.5j) . the boundary integral in (|3.4p must be zero for all 
functions / el. This forces pa to have zero flux across the boundary d£l: 

p x (x,a)FJx) ■n(x)) =0, Vcr G T. (3.6) 

Note that if is the closure of a domain in the system of identities (13. 5p must still 
be valid for (x,cr) G 0° x T, f2° being the interior part of O, since it follows from (13. 2p 
by taking arbitrary functions / which are bounded, C 1 in x and with x-support strictly 
included in f2° . The boundary condition can differ from (13. 6p , depending on the dynamics 
at the boundary. 

As already mentioned, if the process F^ A is stationary, then its time-reversed version is 
again a PDMP. More precisely, we claim that Pp^ + coincides with the law P of the PDMP 
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with state space (JxT, initial distribution p\, force fields 

F+(x):=-F a (x) (3.7) 

and jump rates Ar + (cr, a'\x) where 

r^ia, a \x) := r(a , a \x) — -. r . (3.8) 

(In the above formula, we assume some spatial irreducibility of the system implying the 
positivity of p\(x,a)). Note that writing 

7 +(cr| x ) : = ^ r + (a, a'\x) , (3.9) 

a' 

equation (13. 5p can be written as 

A 7 + {a\x -7 ff i = * • 3.10 

V J P\{x,a) 

In order to prove our claim, due to the stationarity of P^ A we only need to show that 

P(A)=F x px (B), (3.11) 

where the events A and B are of the following form. Fix a measurable set U C 0, k + 1 
chemical states ctq, a±, . . . ,<7fc with Oi ^ <?i+i, k positive times < t\ < ■ ■ ■ < < T 
and e small enough. Define A as the family of paths (x(-), cj(-)) E C(M+,fi) x _D(R + ,r) 
such that (i) there are exactly k jump times rx,T2, . . . ,Tk in the time interval (0, T) and 
T{ E [ti — e, ti + e], (ii) a{r.j) = Oi for < % ^ k and moreover cr(0) = ctq, (hi) x(0) E f7 and 
(iv) i(s) = — F CT ( s )(x(s)) for all s € [0, T) different from the jump times. Then define B 
as the family of paths (x (•),&(■)) such that (i) there are exactly k jumps times r{, . . . ,r' k 
in the time interval [0, T] and t[ £ [T — ifc— i+i — t,T — tk-i+\ + e], (ii) ct(t-) = (Jk-i for 
1 ^ i ^ k and moreover c(0) = (hi) x(T) E C7 and (iv) x(s) = -^(^(^(s)) for all 
s E [0, T] different from the jump times. Trivially, apart time-shift A and T~ 1 B coincide. 
Note that the validity of (|3.1ip for all events A and B as above implies also that P gives 
probability 1 to paths with mechanical variable confined in f2. 

For the sake of simplicity and without loss of generality, in order to prove (|3.1ip we 
take k = 1. Moreover, given xq E U and t E [£i — e,t\ + e], we write (x(-), cr(-)) for the 
unique path in A jumping at time t and such that x(0) = xq. Then, due to (13.80 . (13. 9ft 
and (13.101) . we conclude that 

P{A)= [ tl+e g t dt, (3.12) 



where the density gt is given by 

g t = \ dx p x (x ,(To)r + (ao,ai\x(t)) exp{-A / 7+ (a(s)\x(s))ds} 
Ju Jo 

pxjxjt),^) . s 

dx px{x , cr ) — 1—7- rr{(Ti,a Q \x{t)) 

u Px(x{t),a ) 

( f T 1 c f T v • (px(x(s),a(s))F a(s) (x(s)) 1 

exp 1 - A / 7(o-(s)|x(s))cMexp<^ - / — — — — \ . 

1 7o J 1 Jo Px(x{s),a(s)) J 

(3.13) 
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We note that in the time intervals (0, t) and (t, T) where the chemical state is constant, 
it holds 

V- (p x (x(s),a)F a (x{s))) d 

i '- = -— In p A {x(s),a) + V • F a {x(s)) , 

p\(x{s),a) ds 

where a is the value of the chemical state. Dividing the interval of integration [0, T] in the 
two intervals [0,t] and [t, T], the above identity implies that the last exponential factor in 
(|3.13p equals 

p x (x(t),a )p x (x(T),a 1 ) 



expj- J V ■ F a ^(x(s))dsj 



Px(.x ,a )p\(x(t),a 1 ) 
This observation together with (13.131) allows to conclude that 



gt = X dx Q p x (x(T),a 1 )r(ai,a \x(t)) 
Ju 

xexp{-\[ 7 ( f T( S )|x(s))ds}exp{- / V ■ F a(s) (x(s))ds} . (3.14) 
Jo Jo 

Let us now consider the diffeomorphism (/>:£/—»• <p(U) that associate to xq G U the element 
x(T) £ 4>(U). This is obtained from the composition fa fa where 4>\ maps xq to x(t) and 
4>2 maps x(t) to x(T). By Liouville theorem the Jacobian of the diffeomorphism <f>\ is 
given by 

J^(s ) = e-J? v-F.ro (*«)* > ( 3 . 15 ) 
and the Jacobian of the diffeomorphism fa is given by 

If we perform in (13.141) the change of variables i/q = <P(xq) we obtain 

gt = X dy px(yo,cr 1 )r(a 1 ,ao\y(T - t)) exp{-A / j(a(s)\y(s))ds} := g T -t , (3.17) 
J<j>{u) Jo 

where (y(-), cj(-)) is the unique path in B jumping at time T — t and such that y(0) = yo- 
Now (13. lip follows from (|3.12|) and the identity 

rT-ti+e 
W X px (B)= gtdt. 
JT-tx-e 

A different route in order to characterize the time-reversed process is given by the 
analysis of the generator. Being aware of the subtle difficulties concerning the domain 
of definition of the generator (see Appendix \^ , we keep this analysis at a very heuristic 
level. The generator L + of the time-reversed process must be the adjoint in L 2 (px) of the 
generator L of the direct process, namely 

E PA (gLf) = E PA (fL+g) (3.18) 

for all /, g regular enough. Below we check that this implies the identity 



L + f(x, a) = -F a (x) ■ V/(x, a) + A V r(a', a\x) PA f' - . j (f(x, a') - f(x, a)) . (3.19) 

We can write (I3.19P as 

L+f(x, a) = -F a (x) ■ V/(x, a) + XL+[x]f(x, a) . (3.20) 
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We stress that denotes the chemical part of the adjoint generator L + . In general, this 

is different from the operator L c [x] + , defined as the adjoint in L 2 (p(-\x)) of the chemical 
part L c [x] of the generator L: 

L+[x}^L c [x}+. (3.21) 

The general formula (|3.19p can be easily checked as follows. We start from the left hand 
side of (|3.18p that can be written as 



^2 / dxp x (x,a)g(x,a) 
o-er ^ n 



F a {x) ■ V/(x, a) + A a'\x) [f(x, a 1 ) - f(x, a) 

o-'er 

With a change of variable in the discrete sum and an integration by parts in the mechanical 
variable for which the boundary terms disappear due to conditions (|3.6j) . we obtain 



Y / dxf(x,a) j-V • (px(x,(r)g(x,<T)F a {x) 

+A Y (K^^I^PA^cr'M^cr') ~ r(a,cf\x)px(x,a)g(x,cryj \ 

Using now (|3.5p we get 

Y J dxf(x,a){ - V • (px(x,<r)g(x,<T)F a (xfj + g(x,a)V ■ (p x (x,a)F a (x)) 

+p x (x,a)\Y (r(a\a\x)^p^g(x,a')-r(a\a\x)^p^g(x,a))\ , 
that finally becomes 

Y] / dxp x (x,a)f(x,a) -F a (x) ■ Vg(x, a) + A V] r(cr', A ' r (ff(x, a')-g{x, a) 
oer JU o'er rM ' ; 

This ends the proof of (|3.19p . 

Let us conclude this section with some comments. We have showed that the time- 
reversed process is still a PDMP with reversed vector fields and with probability rates of 
chemical transitions given by (13. 8p . Note that in general these rates can be A-dependent, 
thus implying that the chemical part of the adjoint generator can also be A-dependent. 
Moreover, the chemical part of the adjoint generator £^"[x] is irreducible for all due 
to the irreducibility of L c [x] and the identity (|3.8p . We call p + {-\x) the quasistationary 
measure associated to £^[x] and we remark that it can be A dependent. As already 
observed £^~[x] and L c [x] are not adjoint operators w.r.t. quasistationary measure p(-\x). 
Another consequence of our results is the following: if for any fixed x G Q the chemical part 
L c [x] of the direct generator L is reversible with respect to the quasistationary measure 
p(-\x), then also the chemical part of the adjoint process -£^[x] is reversible with respect 
to its quasistationary measure p + (a\x) and moreover it holds 

P + {<?\x) = ft'") S , (3.22) 
p{a\x)Z\(x) 

where Z\(x) is the normalization constant. In order to justify (|3.22p . one can argue as 
follows. The reversibility of L c [x] is equivalent to the the detailed balance condition 

p(a\x)r(a,a'\x) = p(a'\x)r(a' ,a\x), Vcr, a', ViGO. (3.23) 
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Due to (|3.8p . this relation is equivalent to 

p{a\x)r + (a , u\x) — - = p(a \x)r + (a, a \x) — , 

p\{x,a) P\{x,a') 

that can be written as 

———r^(o,a\x) = r^{a,a\x). 
fjL{a'\x) 

This equation states that the rates r + at x satisfy the detailed balance condition with 
respect to a measure on T proportional to ^Z' x \ ■ The proportionality factor can depend 
on x and on A. This is exactly the content of equation (|3.22|) . 

Finally, a comment about reversibility: due to our results, the direct PDMP can be 
reversible only if all the vector fields F a are identically zero. In this case the mechanical 
state remains constant and the model reduces to the continuous time Markov chain cr(-). 

4. One dimensional models with two chemical states 

In this section we discuss in detail some ID models with two chemical states, for which 
it is possible to compute explicitly the invariant measure. We consider separately the cases 
of 0, interval and ID torus. For simplicity we consider vector fields without equilibrium 
points in f2, although the main ideas presented here can be used in more general cases. 

4.1. Interval. We take f2 = (a, b) C R and T = {0,1}. In order to have some mixing 
and confinement inside Q, we consider vector fields Fq,Fi such that (i) Fq(x) < and 
Fi(x) > for all x £ (a,b), (ii) Fq(o) = Fi(b) = 0. Because of the irreducibility of the 
Markov chain associated to L c [x], the jump rates r(0, l|x) and r(l, 0\x) must be positive 
for all x £ (a,b). The stationarity equations (|3.5p are given by 

X( Px (x,l)r(l,0\x) - p x (x,0)r(0,l\x)) = dJp x (x,0)F o (x)) , 
X(p x (x,0)r{0,l\x) - p x {x,l)r(l,0\x)) = d x (p x {x, l)iq(x)) , 

from which we obtain 

d x ( Px (x,0)F (x) + p x (x,l)F!(x)) =0, 

and consequently 

Px (x,0)F (x) + Px (x,l)F 1 (x) = c. (4.2) 

Due to the boundary condition (|3.6p . we know that c must be zero. Then relation (|4.2p 
allows to solve equations (|4.ip by separation of variables, leading to 

PA (*,*) = ^pr^ , i = 0,l, (4.3) 

where x* is a generic element of (a, b) and Z is the normalization constant, if it exists. 
Note that the boundary condition (|3,6p is automatically satisfied, since by construction 
the constant c in (|4.2p is zero and by assumption Fo(a) = Fi(b) = 0. As the reader can 
check, ()4.3p is the only solution of (|3.5p compatible with the boundary condition (|3,6p . 
It corresponds to a probability measure if and only if the normalization constant Z is 
well-defined. Suppose for example that the jump rates vary in the interval (01,02) with 
ci,C2 > 0, while F\(x) and Fq(x) are of order one near a and b respectively. Then it is 
simple to check that Z is well defined. 



(4.1) 
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Knowing the stationary measure p\, we can compute via (|3.8p the jump rates of the 
time-reversed process: 

F (x) 



FUx 
Fi(x 



J r+(0, l\x) = r(l,0\x) 

\ r+(l,0|x) =r(0, l\x) 

We point out that these rates do not depend on A. Moreover, we observe that in the 
reversed-time process the ^-confinement is related to (I2,14p . while in the direct process 
the ^-confinement is related by (j2. 12|) . 

4.2. Torus. We take Q = R/Z, T = {0,1} and periodic vector fields F (x), Fy{x). We 
assume Fq{x) and F\{x) to be nonzero. Moreover, in order to assure the irreducibility of 
the Markov chain associated to L c [x], we take positive jump rates r(0, l|x) and r(l,0|x). 
The equations for the stationary measure are still (|4.ip to which we have to add the 
periodic boundary conditions 

Px (0,i) = Px (l,i), i = 0,l. (4.4) 

Let us call 

V(0, l\z) r(l,0|z) 



S(x) 



o 



+ 



Fi(z) 



dz . 



x £ 



It is easy to check that, for any constant k, 

k rx+l 



px(x,0) :-- 



f 

■I X 

Fi(x) Jx 



F (x) Jx 
k rx+l 



r(1.0|g) r \(S(v)-S(x)) 

Fi(y) e 
HOMy) X(S(v)-S(x)) 

Fo(y) e 



dy, 
dy, 



(4.5) 



(4.6) 



it 



are solutions of (|4.ip . satisfying the boundary conditions (|4.4p . since for any x,y S 
holds 

S(y)-S(x) = S(y + l)-S(x + l). (4.7) 

Moreover, there exists a unique value of k such that the expressions in the r.h.s. of (14. 6|) 
are positive functions, satisfying the normalization condition 

y / Px(x, a)dx = 1 . 

On the other hand, it is simple to check that the above solution is the only probability 
measure satisfying (|3.5|) and the periodic boundary conditions. Hence, we have obtained 
the unique invariant measure of the model. 

Knowing the stationary measure p\, we can compute the jump rates of the time-reversed 
process: 



r+(0,l|x) 



:1,0k) 



r(l,0|x) 
r(0, l\x) 



PX + l 

Fo(x) Jx 


>Co,Hw) c XS(vV 


dy 


Fi{x) rx+l 

Jx 

_Fi(x) Jx 


r(l,0|v) ASfi/1 


dy 
dy 


Fi(y) 
r(.l,0\v) XSM 
. Fl(v) £ 


Fq(x) rx+l 
Jx 




dy 


. F o(y) 



(4.8) 



Note that in general, the above rates are A-dependent. In order to exhibit cases of A- 
independent rates r + (-,-|x), let us consider the equilibrium condition 

* / r(0,l|*) r(l,0l*) \ 

V F (z) + Fl {z) ) dZ U - (4 ' 9j 

We point out that this condition can hold only if the vector fields Fq and F\ have opposite 
sign and that it is equivalent to the fact that S is a periodic function of period one. We 
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claim that the rates r + (-,-|x) do not depend on A if the above equilibrium condition is 
satisfied. In fact, in this case, from the definition of S and from its periodicity we obtain 
that 



x+l 



r(l,0\y) , r(0,l\y) \ xs{y) 
Fi(y) + F (y) 



1 ( e XS(x+l) 



From (14.8)) and (I4.10|) we conclude that 

J r+(0, l|x) 
I r+(l,0|x) 



dy 



-Ko,i|-)ft|. 



,\S{x) 



0. 



(4.10) 



(4.11) 



Remember that in this case the vector fields have opposite sign so that the above rates 
are positive. 

When condition (14. 9p is violated then rates (|4.8f) can be A-dependent. In this case we 
can study the asymptotic behavior of p\ as A | oo using some classical results (see for 
example [7J) that we recall for the reader's convenience. Let / and S be smooth real 
functions on the interval [a, b]. If <S(y) < S(a) for any y £ (a, b] and S'(a) < 0, then it 
holds 

f(a) 



lim 

A— >oo 



f°f(y)e^dy 



S'(a) 



(4.12) 



If there exists y* E (a, b) such that S(y) < S(y*) for any y S (a, b) different from y* and 
moreover S"(y*) < 0, then it holds 



lim Ja J yy> 

A— >oo 



h " -^(») dy 



2tt 



S»(y*) 



(4.13) 



Let us suppose that the function S defined by (14. 5|) is regular and that for any x ^ 
the maximum of the function S in the closed interval [x, x + 1] is assumed in at most one 
point of the open interval (x,x + 1). This fact is guaranteed if for example S(z\) ^ S(z2) 
for any pair of critical points z\ and Z2 (i.e. such that S'(z\) = S'(z2) = 0). If Fq and F± 
have the same sign, this is always true since the function S is strictly increasing or strictly 
decreasing. Moreover, note that in general x and x + l cannot be both maximum points 
of the function 5 on [x, x + l], since due to (j4.7l) the identity S(x) = S(x + 1) would imply 
the periodicity of S. In addition to the previous assumptions, we require that S"(y) < 
if the maximum of 5 on the interval [x, x + l] is reached at the internal point y. We point 
out that by the methods discussed in [7] more general cases can be considered. 

Given x ^ 0, we define y{x) G [x,x + 1] as follows. We require that S(y{x)) = 



max. 



ye[x,x+i] S(y)- If the maximum point in [x, x + 1] is unique, then y{x) is univocally 
determined from the above condition. The only other possibility is that there is a maxi- 
mum point at the boundary and a maximum point in the interior of the interval [x, x + 1]. 
In this case, we define y(x) as the unique maximum point inside (x,x + 1). 
From the results (|4. 12[) and f|4. 13[) it is easy to derive that 



'(o,ik) 

(l,0|x) 



r(l, 0|x) 



F (x) 


r(0,l 




FUx) 
Fxlx) 


r(l,0 
r(l,0 


y{x))F (y(x)) 
y(x))Fo(y(x)) 




r(0,l 


yix^Fjiyix)) 



+ o(l), 
+ o(l), 



(4.14) 



where by o(l) we indicate a term which is infinitesimal as A diverges. Note that the first 
terms in the r.h.s. of (I4.14p are A-independent. 
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Note that if y(x) G {x, x + 1}, by the periodicity of F a (x) and r(a, cr'\x) formula (|4.14jl 
reduces to 

r+(0,l|z)=r(0,l|ar) + o(l), . . 

r+(l,0\x) = r(l,Q\x) +o(l). { 1 

This is always true if the vector fields Fq and F\ have the same sign, since in this case the 
function S is monotone. On the other hand, if y{x) G (x,x + 1), then necessarily it holds 

S'(yW) = ^#vT + r( iV 0| y ( ff = > (4-16) 



and (I4.14p reduces to 



r +(0,l\x) = -r(l,0\x)m + o(l) 
r+(l,0\x) = -r(0,l|x)gg+o(l) 



(4.17) 



We conclude this section by pointing out another consequence of the equilibrium con- 
dition (|4.9j) . which we know to be equivalent to the periodicity of the function S. Setting 



C(A) 



o 



r(i,o\y) 

Fi(y) 



dy, 



due to (|4,10p . equations (|4.6p read 



Px (x,l):=^e-^. ^ 



5. Exactly solvable models 

In general it is difficult to obtain a closed expression for the invariant measure of our 
PDMPs. In this section we discuss a class of models for which this is possible and the 
invariant measure has a special structure. 

5.1. General framework. The exact solutions of the ID models discussed in the previous 
section suggest to look for invariant measures of the form 

p x (x,a) = c(X)e- xs ^p(x,a), (5.1) 

where c(A) is a normalization factor depending only on A, S(x) is a function depending 
only on x and p(x, a) is a measure density onfixT non depending on A. 

Let us discuss some consequences of (|5.1|) (other aspects will be discussed later, when 
studying the fluctuations of our models). If the PDMP has invariant measure of the form 
(|5.ip . then the rates r + of the adjoint process do not depend on A: 

r+(a, a'\x) = r(a', a\x)^^- . (5.2) 

p{x,a) 

In particular, the chemical part L+[x] of the adjoint generator L + does not depend on A. 
This implies that the quasistationary measure p + (-\x) does not depend on A. Moreover, if 
L c [x] is reversible with respect to the quasistationary measure p(-\x), then (|3.22p becomes 



16 



A. FAGGIONATO, D. GABRIELLI, AND M. RIBEZZI CRIVELLARI 



Let us analyze now when (J5JJ) can be a solution of the stationary equations (13.5|) . 
Examples will be discussed at the end of this section. Inserting (|5.ip in (j3.5H . we obtain 
that for any a G V it must hold 



Ac(A)e" A5(x) (p(x,a')r(a',a\x) - p(x,a)r(a, a'\x] 



-Xc(X)e~ xs ^VS{x) ■ (p{x, a)F a {x)j + c(A)e" A5 ^ V • (p(x, a)F a {x)^j . (5.4) 
Dividing by nonzero terms we get 

a[ ^2 ( y P( x i cr ') r ( (J ^ '\ x ) - p{ x i (T ) r { a ^ cr '\ x )^ + V5(x) • (^p(x, a)F a (x)j (5.5) 
o-'er 

+V ■ (p(x,a)F a (x)) =0. (5.6) 



In the above formula we have a first order polynomial in A and we have equality to zero 
for any value of A if and only if the coefficients of the zero and first order terms are equal 
to zero separately: 



V- [p(x,a)F a (x) =0, 

( \ ( \ ( 5 - 7 ) 

T^a'er yp(x,cr)r(a,a'\x) - p(x,a')r(a',a\x)j = V5(i) • ( p(x, a)F a (x)J . 

The first equation, one for any fixed a G T, can be written as 

Vip(x,a)-F (T (x) = -V-F a (x), (5.8) 

where we set (p(x, a) = log p(x, a) (here and below we suppose that p(x, a) > for all 
(x,a) £ $1 x r due to some mixing property of the system). Under the same assumption, 
the second equation, one for any fixed a € T, can be written in the equivalent form 

j(a\x) - 7 + (cr|x) = VS(x) ■ F a {x) . (5.9) 

Equation (|5.8p is a non-homogeneous transport equation along the orbits of the vector 
fields Ffj. The important fact is that, as a varies, these equations are uncoupled, hence 
one can easily integrate them. We distinguish between closed and open orbits. 

Closed orbits: Let 7 C be a closed orbit of the vector field F a , let xq be any element 
of 7 and let x 7 (t) be the parametrization of 7 such that x 7 (0) = xq and x 7 (t) = F a (x 1 (t)) 
for all t G [0, T], where T is the period of the orbit (note that x 7 (0) = x 7 (T) = xq). Given 
x' £ 7, let t' be the only time in [0, T] such that x' = x 7 (t'). Then (|5.8p implies that 

ft' 

ip(x' ,a) — tp(xo,a) = / Vip(x.y(s), a) ■ x 7 (s) ds = 







f V<£(x 7 (s),cr) • F a (x y {s))ds = - [ V • F a (xj(s)) ds . (5.10) 
Jo Jo 

This implies that a function (p satisfying (|5.8p can be constructed along 7 if and only if 

the univalued condition 

/ V-F CT (x 7 (s))(is = (5.11) 

Jo 

is satisfied. Moreover the values of ip on 7 are uniquely determined from (|5.10p once the 
initial condition tp(xo,o~) has been arbitrarily fixed. 

Open orbits: Let 7 C £1 be an open orbit of the vector field F a and consider xo £ 7- Let 
x 7 (£) be a parametrization of 7 such that x 7 (t) = F a {x 1 {t)) and x(0) = xq. Given x' G 7, 
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let if be the unique time such that x^it') = x' . Then (15.101) continues to hold and we can 
determine the value of (p(x',a) for any x' G 7 starting from the arbitrary initial condition 

Once determined p(x, a) by integration of the first group of equations in (|5.7p . we need 
to find a function S satisfying the second group of equations in (|5.7p . Let us call 

D(x,a) := ^2 (yP{ x i a ) r { (J i (T '\ x ) ~ p(x,a')r(a' ,a\x)\ . (5.12) 
cr'er 

Then, the second group of equations in (15. 7p reads 

D(x,a) =VS(x) ■ (p(x,a)F a (x)) , V(i,(j)£fixr. (5.13) 

This means that, for any a G T, D(x,a) is the directional derivative of S at x along the 
vector p(x, (j)F CJ {x). In fact, given a vector v G W 1 the directional derivative of S along v 
at x is given by 

S(x + tv) — Six) , 
Jim— — = VS{x)-v. (5.14) 

Let us assume that there exists r(a;) C T with the property that the vectors p(x, a)F a (x), 
G r(x), are linearly independent and satisfy 

Span{p(x,a)F a (x)} a&T{x) = Span{p(x,a)F a (x)} a& = R d , (5.15) 
where for generic vectors v\,...,Vk in M. d we write 

k 

Span {vi} i=1Jt : = |u G M d : u = ^ A^j , Aj G R j . 

i=l 

Note that (j5.15[) implies the identity d = |T(x)| and that, since p(x,a) > 0, (15.150 is 
equivalent to the condition 

Span{F a (x)} a£T{x) = Span {F a (x)} aeT = R d . (5.16) 

Due to (|5.15p . for any a* T(x) there exist real numbers c a (cr*,x) such that 

p(x,a*)F a *{x) = ^2 c a (a*,x)p(x,a)F a (x) . (5.17) 
o-er(z) 

Let us recall a trivial consequence of (I5.14|) : given vectors v, v\, . . . , Vk such that v = 
Yji c i v -h h holds 

Six + tv) — S(x) v-^ n S(x + tvi) — Six) 
lim^ ^ K -L = J2c i VS(x)-v i = J2^ - f — ■ (5-18) 

i i 

From (I5.17P and (I5.18P we get that a necessary condition for the existence of the function 
5 is given by the family of identities 

D(x,a*)= c a (a*,x)D(x,a) Vct* &T(x). (5.19) 

o-er(x) 

We now derive a second necessary condition concerning D. Let d y be the 

d x d matrix, with rows labeled by the spatial dimensions and columns labeled by the 
chemical states in T(x), defined as follows. The column with label a is given by the vector 
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p(x, a)F a (x), i.e. Ai t<T {x) = p(x, a)F a (x) ■ ej, where (e^, 1 ^ i ^ d) denotes the canonical 
basis of This definition implies that 

d 

p(x,a)F a (x) = J2 A iA x ) e i, Vaer(x), (5.20) 

i=l 

as well as 

ei= Yl Kl( x )pi x ^) F <r{x) , Vi:l^i^d. (5.21) 
o-er(z) 

The matrix A^ 1 (x) is the inverse of the matrix A(x) and has columns labeled by the spatial 
dimensions, and rows labeled by the chemical states in T(x). Since {D(x,a)} a£T ^ must 
correspond to directional derivatives of a function S on f2, due to (15. 18f) and (I5.21|) it must 
be 

o* i s(x)= Yl Kfe) D M- ( 5 - 22 ) 

Consider a closed curve 7 C 0, with parametrization {^(t)} (e j 0I ,j. Since 7 is closed, it 
must be 

0=/ Vfl'(a? 7 (*))-ar 7 (a)(fo. (5.23) 



Using (I5.22p the above identity becomes 

°= E( E A-J( aJ7 ( a ))D(x 7 ( S ), < 7))i 7)i ( a )(fo= L, (5.24) 
where u; is the differential form 

d 

^ = E( E A-HaODCs,*))^. (5.25) 
i=i o-er(x) 

The validity of condition (I5.24|) for any closed curve 7 is equivalent to require that the 
differential form (15.25)) is exact. When the domain Q is simply connected, exactness of u> 
is equivalent to say that 

E Kfa) D M)=9*j{ E A 7fa)DM)> ( 5 - 26 ) 

We can now collect all our observations and reach a conclusion: conditions (|5.15p and 
(I5.19P together with the exactness of u allow to determine a solution S of the second group 
of equations in (j5.7fl . up to additive terms, as follows. Fix an arbitrary point x* 6 £1 and 
a corresponding arbitrary value S(x*). Given an arbitrary curve 7 that starts in x* and 
ends in x 6 f! (recall that for simplicity we have taken f2 connected), the value S(x) is 
given by 

S(x) = [ u + S(x*). (5.27) 



Due to the exactness of u> this value does not depend on the particular curve 7 chosen. 
Note that by construction dS = dco, and therefore (|5.22p is satisfied for any direction i. 
Due to (|5.20p . (|5.2ip and (|5.18p . this implies that D(x,a) is the directional derivative 
of S along the vector p(x, o)F a (x) at x, for any x £ fl and for any a £ T(x). Due to 
condition (I5.19P and to the additivity property (15.181) . the same result extends also to 
states o £ T \ F(x). Hence, the function S satisfies the second group of equations in (|57 
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Above we have constructed solutions of (13.51) having the special form (|5.1f) . To have 
that these solutions coincide with the invariant measures of the PDMP, we have to impose 
the boundary conditions (|3.6I) if O is a bounded domain in R d , or periodic boundary 
conditions in x if is the <i-dimensional torus. This has to be done, when possible, using 
the arbitrariness in the initial data in the above construction. 

We end our general discussion with a remark. Since by definition (|5.12|) the sum 
X^o-er D{x, a) must be zero and since by (|5.7f) it holds D(x,a) = VS(x) • (p(x, a)F a (x)) , 
it must be 

VS(x) ■ /°0> a ) F <r( x ^j = • ( 5 - 28 ) 

In particular, the orbits of the vector field ^2 a£ j- p(x,<r)F a (x) must lie inside the level 
curves of S. 

5.2. Examples. We now exhibit solutions of (13. 5D in specific examples by means of the 
above construction. The reader can easily check that our solutions satisfy the appropriate 
boundary conditions so that they correspond to the invariant measure of the PDMPs 
under consideration. 



5.2.1. Interval. We review the PDMP of Subsection 14.11 by means of the general method 
described above. We keep the notation and assumptions already stated in Subsection 14. 11 
In particular, 0, = (a, b), F\ has a unique orbit, which is open and exits from a, while 
Fq has a unique orbit, which is open and and exits from b. We fix an arbitrary point 
G (a,b). Given x(t) the solution of 

*(oj -2; (5 - 29) 

then due to (|5.8|) for any x G (a, b) the function ip(x, 1) = log p(x, 1) satisfies 

(p(x,l)=(/>(x m )- [ V -Fi(x(s))ds (5.30) 
Jo 

where the time t is such that x(t) = x and (f>{x*) is an arbitrary constant. Differentiating 
([5729]) we get 

' 7 ' (M v-fi(z( a )) 



x{s) 

/** d Fi(x*) 
/ — (log x(s))ds = <f)(x+) +log- 
Jo ds 



that inserted in ()5.30p gives 

ip(x,l) = 0(x*> , .... „ , , 

F x (x) 

The above identity and similar arguments applied to the vector field Fq imply that 

\p(x,0)=e^^l, (5 ' 31) 

where also ip(x*) is an arbitrary constant. It remains now to determine the function S 
and afterwards to fix the arbitrary constants. Taking T(x) = {1} for any x£ll, condition 
(I5.16P is satisfied. Due to (|5.3ip . we can express the constant c±(0,x) in (I5.17|) as 

Cl (U ' X) - p(x,l)F 1 (x) ~ e^)F 1 (x.) ■ [5 - 62) 
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Since in addition D(x,0) = —D(x, 1), condition (|5.19p is satisfied if and only if ci(0, x) = 
— 1. To this aim we take e^ x *> = —1/Fq(x*) and e^ x *^ = 1/Fi(x*). By this choice, the 
differential form (|5.25p is given by 

„- D ^ l \ A /jg + !M) fc (5.33) 

The form u> is trivially exact, being a ID form on a simply connected domain. Then, by 
formula (|5.27|) and the previous computations, we get (|4.3|) as a special case of (|5.ip . 



5.2.2. ID torus. In the case of the ID torus discussed in Subsection [321 we have ft = R/Z 
and both Fq and F% have a closed orbit that coincide with Q. In both cases the univalued 
condition (|5.1ip is satisfied due to the fact that on the periodic orbit x(t) solution of 
x = Fi(x) with period T we have 

r T r T d 

/ V • Fi(x(s))ds = I — (logx(s)) ds = 0. 
Jo Jo ds 

We can repeat all the arguments and computations of the case ft = (a, b). The only 
exception is that now the form u given by (|5.33|) is not automatically exact, since O is 
not simply connected. The requirement that u = is exactly the equilibrium condition 
(fOl) . The final result coincides with P~THj) . 

5.2.3. Triangular domain. . Let us now discuss a simple but non trivial example in di- 
mension d = 2 of a PDMP with an invariant measure of the form (|5,ip . Let C R 2 be 
the open triangle with vertices (0, 0), (1, 0), (0, 1) and let (x, y) denote a generic element of 
fl. The set of chemical states is T = {1, 2, 3}. The vector fields associated to the chemical 
states are obtained from the gradients of quadratic potentials centered at the vertices of 
the triangle. More precisely 

Fi(x,y) = - JV(x 2 + y 2 ) = (-x, -y) , 
F 2 (x, y) = -|V Ux - If + y 2 ) = (1 - x, -y) , 
F 3 (x, y) = -|V (x 2 + (y- l) 2 ) = (-x, 1 - y) . 

All the orbits of the above vector fields are open and condition (|2.12|) is satisfied. Moreover 
the orbits of the vector fields Fi exit from dVlf C dfl, where dflf is the segment with 
extrema (0,1) and (1,0); dfl^ is the segment with extrema (0,0) and (0,1); dfl^ is 
the segment with extrema (0,0) and (1,0). Let us determine the function (p(x,y,l) = 
log p(x, y, 1) by means of the discussion following (|5.8p . To this aim, we observe that given 
(x,y) £ Q the path (x(t),y(i)) := (e _i ,e _t y/x) satisfies 

{±(t),y(t)) =Fi(a:(t),i/(t)) , Vt > t , 
(x(t ),y(t )) = {x/(x + y),y/(x + y)) G dfl+ , 
(x(ti),y{ti)) = (x,y) , 

where to := l°E,{( x +y)/ x ) an d t± := log(l/x). In particular, the above path parameterized 
by t ^ to is an orbit of F% exiting from dQ,f and passing through the point (x,y). Fixed 
an arbitrary function <p\ : (0, 1) — > R we obtain using (|5.10p 

/ x \ f log x 
<p(x,y,l)-<l> 1 [——)=2 dt = -2log(x + y) , 
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(x+y)^ " Note that this can be rewritten as p(x,y,l) = a\{x/{x + 
R. In conclusion, by similar arguments, we get 



so that p(x, y, 1) 

y))/x 2 for a suitable function a± : (0, 1) 
that 

p(x,y,l) = a x 



P(x,y,2) = a 2 



(5.34) 



l—y J ' 

for positive functions 01,02,03, which can be chosen arbitrarily. Note that the point 
(0, yj (1 — x)) is the exit point in 80,2 °f the i^-orbit passing through the point (x, y) £ J7, 
while (x/(l — y),0) is the exit point in dQ^ of the i^-orbit passing through the point 
(x,y) G 0. 

In order to determine the function S of (15. ip . for any (x, y) £ f2 we take r(x, y) = {2, 3}. 
Trivially condition (15. 16f) is satisfied. Moreover, we can compute 02(1, x,y) and €3(1, x,y) 
of (I5~T71) : 

L^pfeS' (5 - 35) 

At this point, the check of condition (|5.19p depends strongly from the form of the the 
rates r(-,-\x,y). Indeed, omitting the dependence from the point (x,y) (for the sake of 
simplicity) condition (|5.19|) becomes 



r(l,2)+r(l,3) 



^> r(2il) _4|L (M) 



x 



x + y — 1 



r(2,l)+r(2,3) 

y 



P(2) 
r(3,l)+r(3,2) 



r(l,2) 



P(3) 
P(2) 



r(3,2) 



+ 



, . p(2) , . 
' v V(l,3)-^-(r(2,3) 



(5.36) 



x + [ ' ' p(3) v ' 7 p(3) 

As the reader can easily check, the above identity is automatically satisfied for all kind of 
jump rates if 

p(\) _\-x-y p{2) _ x p(l) _l-x-y 

1 

y 



(5.37) 



p(3) y p(3) y p{2) x 

In order to satisfy the above identities it is enough to take 01, 02, 03 in (|5.34[) as ai(u) = 
Y^-. By this choice, (|5.34p reads 

p(x,y,l) = l/(xy) , 

p(x,y,2) = l/[y(l-x-y)], (5.38) 
p(x,y,3) = l/[x(l -x-y)]. 

It remains now to compute the form uj given by (|5.25p . check when it is exact and after- 
wards check the boundary condition (13.6H . First we observe that 



A(x,y) 



1 



l-x 

y 

1-x-y V -1 



-1 



A L (x,y) 



y(l - y) xy 
xy x(l — x) 



Therefore 

w = - y)-C(^, 2/, 2) + xyD(x, y, 3)] dx + [xy.D(x, y, 2) + x(l - x)D(x, y, 3)] dy . 
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We have 

uj = B(x, y)dx + C(x, y)dy 
where (omitting the dependence on (x, y) for simplicity) 

B(x, y) = 1 ~ V r(2, 1) - — ^r(l, 2) + V - r(3, 1) - r(l, 3) + r(2, 3) - ^r(3, 2) , 

1 — x — y x 1 — x — y x 

C(x, y) = 1 ~ X r(3, 1) - — -r(l, 3) + r(2, 1) - r(l, 2) + r(3, 2) - -r(2, 3) . 

1 — x — y y 1 — x — y y 

Note that C(x,y) can be obtained from B(x,y) by exchanging x with y and 2 with 3. 
If, motivated by the geometric symmetries of fi, we assume that 

r(l,2\x,y) = r(l,3|y,x) , r(2, l\x,y) = r(3, l|y,x) , r(2,3|x,y) = r(3,2|y,x) 

then 

uj = B(x, y)dx + B(y, x)dy . 

In this case, since is simply connected, u is exact if and only if d y B{a,b) = d y B(b,a) 
(cf. (|5.26p ). i.e the function d y B is symmetric. 

Let us discuss an example, where the above condition is satisfied. We take r(a, cr'\x, y) = 
1 for all a ^ a'. Then one easily compute the above B(x,y) and C(x,y), getting 

2x + y-l , 2y + x-l 

u> = — -dx + — -dy , (5.39) 

x{l-x-y) y(l-x-y) 

which is exact since the domain is simply connected and condition (15.260 is satisfied. 
Integrating the form u> as in (I5.27p . we obtain up to an arbitrary constant 

S(x,y) = / uj = — log x — logy — log(l — x — y) . (5.40) 

By collecting our results (I5.38|) and ()5.40p . we obtain that the invariant measure is of the 
form (15.11) and that 



P\ = [P\(x,y, l),p\(x,y,2),px(x,y,3)^ 

c(A) (x^Y-Hl -x- y)\ x x y x -\l -x- y) x ~\ x A ~V (1 - x - y)^ 1 ) . 

Above, c(A) is the normalization constant, which is well-defined as the reader can eas- 
ily check. Finally, we observe that the above invariant measure satisfies the boundary 
condition (13. 6p . 

Note that, due to (|5.34|) . (|3.6p can be satisfied only if S diverges to — oo when ap- 
proaching the boundary of the triangle Vt. This is a strong restriction. For exam- 
ple, if we tale r(3, 2\x,y) = r(2,3\x,y) = , r(2, l\x, y) = r(3, l\x, y) = 1 — x — y, 
r(l, 2\x, y) = r(l, 3\y, x) = x, we obtain that u> = dS where S is a constant function, thus 
leading to a solution of the stationary equations (|3.5|) . but not satisfying the boundary 
condition (|3.6p . 

5.2.4. 2D torus. We take U = R 2 /Z 2 and T = {0, 1}. We call (x,y) a generic element of 
£1 and choose vector fields 

F {x,y) = {f{x,y),0), 
Fi{x,y) = (0,g(x,y)) , 
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where / and g are regular functions which never vanish on £1. The chemical part of the 
generator is determined by the transition rates r{i,i — \\x,y) i = 0, 1. The first group of 
equations in (15. 7p can be easily solved: 

(<*™°) = 3$Ky. 

where 4> and 4> are arbitrary functions. Moreover we have that 

A~ l (x,y) = 
hence u can be written as 

u _( KMM _ ^(aMi,o|g,y) \ da , , / r(i,o|z,2/) _ 4>(y)r(o, M x ,y) \ d / 5 41 n 
V /0,y) " <i>(y)g{x,y) ) x V " 4>^)f(x,y) ) V ' 

Fix arbitrary points x*,y* £ [0, 1] and consider the associated fundamental cycles on 17 

7 1 (i) = (i,y*) t€[0,l], 
7 2 (t) = (x*,t) t€[0,l]. 

The exactness of (15.41 f) is equivalent to impose conditions (15.260 with the additional 
conditions 

u = 0. (5.42) 

If we call H(x, y) = (p(y)r(O, l\x, y)j f(x, y) and G(x, y) = (p(x)r(l, 0\x, y)/g(x, y), then we 
can write oj as 

H(x,y) - G(x,y) G[x,y) - H(x,y) 
uj = — dx + j— dy , 

hence the above exactness conditions become 

tiH(x*,y)dy = JiG(x*,y)dy, 
J^H(x,y*)dx = f^G(x,y*)dx, 

~ ( G(x,y)-H(x,y) \ _ fl / H(x,y)-G(x,y) \ 

° x \ 4>(x) ) - °y \ m ) ■ 

Examples of rates r(i,i — l\x, y) satisfying these conditions can be easily constructed. 

5.2.5. Square domain. We consider the open square net 2 with vertices (0,0), (0,1), 
(1, 0) and (1, 1). The chemical states are T = {0, 1, 2, 3} with associated vector fields 

Fo(x,y) = (~x,-y) , Fi(x,y) = (1 - x,-y) , 
F2{x,y) = {-x, l-y), F 3 (x,y) = q(1 - x, 1 - y) , 

where a is a positive parameter and (x, y) is a generic element of £1. We choose the jump 
rates as 

r(0, l\x, y) = r(0, 2\y, x) = q(x, y) , r(l, 0|x, y) = r(2, 0|y, x) = r(x, y) , 

Ki, 3 k, y) = r ( 2 > %> x ) = Q( x , y) > r ( 3 > J-k, y) = r ( 3 ; 2\y, x) = R{x, y) , 

where q, r, Q and i? are arbitrary positive functions and moreover r(l, 2\x, y) = r(2, l\x, y) = 
0. 
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Proceeding as in the previous examples we obtain a solution of the form (|5.ip if we 
require that the rates satisfy the following relations: there exists a function G(x, y) such 
that 

q(x, y) - Q(x, y) = G(x, y)x , 
r(x, y) - = G(x, y)(l - x) . 

and there exists a symmetric function s(x,y) and a function <p such that 
xR(x, y) — a(l — x)Q(x, y) = ax(l — x) I / du s(x, u) + 4>(x] 



where z G (0, 1). Under the above conditions we have a solution of the form (|5,ip with 

jx t-y nx j-y 

S{x,y) = / dw I dus(w,u)+ / dw 4>(w) + / du(f)(u). 



and 

P(x,y,0) = ±, p(x,y,l) = ^izjy , 
P(^y,2) = jp^y, p(a,y,3) = a{1 _^ )(1 _ y) 

Boundary conditions (|3.6p are not necessarily satisfied. 



6. Averaging and large deviation principles in the high frequency limit 

In this section we study the asymptotic behavior of our PDMPs and the corresponding 
time-reversed versions as the parameter A diverges to infinity. By this limit, the frequency 
of chemical jumps diverges and the timescale of chemical jumps becomes infinitesimal w.r.t. 
the relaxation time of the mechanical state. Below, we recall some rigorous results derived 
in [12], where the interested reader can find a more detailed discussion. 

In order to describe the asymptotic behavior of the system and analyze deviations from 
it, we need to specify carefully both the limit procedure and the involved spaces. Given 
a time interval [0, T], a trajectory { x (^)} tg [o T] °^ ^ e mechanical variable is a continuous 
function x : [0, T] — > $7. It is then natural to consider the mechanical trajectories as 
elements of the path space C([0, T\,Q) endowed with the topology induced by the sup 
norm. A chemical trajectory {o"(i)}t g [o t] ^ s an element of the Skorokhod space D([0, T],T) 
of right continuous functions having left limit and taking values in T = {oi, . . . , o"|r|}- To 
a chemical trajectory we associate the following time-dependent (i-dimensional vector 

M*)}te[o,T] ^ WHtep.T] = { ( X^i (*)>••• >X*|r|(*)) } 

where 

'\ iia(t) = a, 



te[o,T] 



Xa{t) 



if a(t)^ a. 



We denote by A4([0,T]) the space of nonnegative finite measures on the interval [0, T], 
endowed of the weak convergence topology. Namely, [i n — > [i in A4([0, T]) if and only if 
Jo f (P) Pnidt) — > J Q f(t)fi(dt) for all continuous functions / on [0, T]. Then we isolate the 
subspace A4o([0, T]) C A4([0, T]) given by the measures that are absolutely continuous 
w.r.t. the Lebesgue measure. We can interpret {x(t)}t£[0T] as an element of the cartesian 
product A4q([0, T]) r by identifying {Xo-(i)}tg[o,T] w ^ n the measure x<r{t)dt. If our PDMP 
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starts in the state (xq, cto), we can think its evolution {x(t), x(t)}te[0,T] as an element of 
following subset y xo of C([0, T], 0) x M ([0, T]) r : 

y xo = {{x(t),xW}t e[ o,n G <?([(), T],Q) x ^ ([0,T]) r : 

x<y (i) = 1 o.e., = x + f ^ (is} . (6.1) 

Above, as in the rest of the paper, we write {x(t), x(t)}te[o,T] instead of {(x(t), x(t))}t£[o,T] 
in order to simplify the notation. Moreover, in the above formula and hereafter we identify 
measures in ,Mo([0, T]) with their corresponding densities. It can be proved (cf. [12]) that 
y xo is a compact subspace of C[0, T] x M[0, T] r , and its topology can be derived from the 
metric d defined as 

d({x(t),x(t)} t £[o,T} , {x(t),x(t)}te[0,T]) = 

sup \x(t)-x(t)\ + y2 sup / [xa(s) - Xa(s)]ds . (6.2) 
tefojl <t <r Jo 



Moreover, in [12] we prove the following law of large numbers. Given (x, a) G x T, 
we define the mean vector field F(x) as the average with respect to the quasistationary 
measure fJ,(-\x) of the fields F a (x): 

F(x) = ^2^(a\x)F a (x). (6.3) 

Given the initial state (xo, ctq), we call {x*(t), x*(t)}te[o t] * ne unique element of y xo such 
that 

' x*(t) = F(x*(t)), 
x*{0) = x , (6.4) 
X* a (t) = »(a\x*(t)). 

Then, the following law of large numbers holds: 



lim P 



A 



d({x(t), x(t)}te[o,T] > K(*)> X*(t)} W] ) >5 = , V5 > , (6.5) 



where the law CT0 of the PDMP starting at (xq, 0o) and having parameter A is thought 
of as a probability distribution on y XQ . Above {x(t), x(t)}t£\o t] denotes a typical element 
of y xo . Finally, we point out that the limit element {x*(f),x*(i)} ig [ 0T ] is independent 
from the initial chemical state ctq. 

The above law of large numbers is a typical example of Averaging Principle. Indeed, 
we are dealing with a stochastic dynamical systems with fully-coupled fast and slow vari- 
ables. In the high frequency limit, the fast variables x average according to the local 
quasistationary measure as the slow variables x would be frozen, while the slow variables 
x feel the averaged vector field F. 

We briefly illustrate a Large Deviation Principle, where the probability of deviations 
from the above law of large numbers is computed on exponential scale. For precise state- 
ments and rigorous proofs we refer to [12], while we keep here the exposition at a more 
heuristic level. We are interested in the exponential probability rate of rare events, namely 
we look for a functional J[o,t] on 34o such that, for any fixed path x(f)} £ y XQ , it 
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holds 

Hon ({*(*), x(*)Wn « x(*)W]) ~ e- XJl0 ^ mm ^^ . (6 . 6) 

In the above formula, {x(t), x(t)} te \ ?>] ^ s a generic element of y xo , the symbol as means 
closeness in the metric of y xo and finally ~ means asymptotic logarithmic equivalence in 
the limit of diverging A. The functional J\o t\ 1S called the rate functional. 

For our PDMPs such a functional exists and has a variational representation. In order 
to describe it, we fix some notation. We denote by W the set of pairs 

W := {{a, a') efxT : a ^ a'} . 

Given a point x G Q and a vector x£ [0, l] r , we define 



j(x,x) ■■= sup x*r(a,o-'\x) 



Zrr 



(6.7) 



Then the rate functional J[o,t] '■ 34 —* [0, oo) is given by 

J[o,T}{Ht),x(t)} te[Q)T] ) := I j(x(t), X (t))dt. (6.8) 

J 

Note that the above functional does not depend on <to, but depends on xq since its domain 
is given by y xo . 

If, given x £ f2, the chemical part L c [x] of the generator is reversible w.r.t. the quasi- 
stationary measure fi(a\x), then one can solve the variational problem (16. 7h (see [12j for 
dettails) getting: 



j( x ,x) = ^l{v\x)Xa - ^2 \l ■^j^ r ( a ^ a '\ x )\^Vx^' '■ (6.9) 

<y (a,a')£W V ^ a \ X > 

We know that the above condition is always satisfied if |T| = 2. Writing V = {0, 1} one 
easily computes j{u,x) as 

j(x,x) = (Vxor{0,l\x) - Vxir(l,0|x)) 2 . (6.10) 

6.1. LDP for the mechanical state. It is natural to analyze the statistical behavior of 
the mechanical variables alone, since often the chemical variables remain hidden to direct 
observations. To this aim, by means of the contraction principle [11], one can derive the 
LDP rate functional JJq T i '■ C([0,T],Q) — > [0,oo] for the mechanical variables from the 
joint (chemical and mechanical) rate functional </[o,t] defined above. In particular, given 
an element {£(i)}te[o,T] S C([0, T], f2), for each initial state (xo,0o) it holds 



where 

^T]({^(*)}te[o,T]) = r mf ^[o,T] x(i)} te[ o,T]) ■ (6-11) 

{{x(*)}te[0,T] :{^W,xW} tG [0,T]6^o} 

Above, we have used the convention that the infimum over the empty set is defined as 
+oo. From expression ()6.8p we obtain that the functional J^ T j '■ C([0,T],Q) — > [0, oo] 
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equals 

J[o,T] mmteiw) ~ i +oo otherwige (6-12) 



where 

yZ ■= {{<t)}t^,T] ■ 3{x(t)W[o,T] s-t. {x(t),x(*)}te[0,T] G^o}. 
and the density j m (x,x) is given by 

j m (x,x)= inf i(x,x)- (6.13) 

In the above formula, \ varies among vectors in [0, l] r such that YlaXv = 1- 

In general an explicit computation of j m depends on the specific model we are dealing 
with. In formula f)6. 13|) we are minimizing over all possible convex decompositions of the 
vector x with respect to the collection of vectors {F a (x)} aGT . A special case is when for 
any the collection of vectors {F a (x)} a&T are the vertices of a simplex, i.e. the vectors 

{F aj — F cri : 2 ^ j ^ |r|} are independent (writing T = {aj : 1 ^ j ^ |r|}). In this case if 
the vector x belong to C ({F tT (x)} aer ) , where the symbol C(-) denotes the convex hull, then 
there exists a unique probability measure on T, x F (x), such that x = J2 a X F ( x )F a (x)- 
The X V s ) are called the bary centric coordinates of x with respect to the collection of 
vectors {F a (x)} a£r . The upper index F indicates the dependence on the vector fields, the 
dependence on x is understood. When x C ({F cr (x)} cr£r ) then the infimum in (|6.13|) is 
over an empty set and we obtain 

j m (x,x) = [iieC ({WW) • (6.14) 

I +oo otherwise . 

We will compute the rate density j m (x,x) in specific examples in the next section. 

6.2. LDP for the time— reversed process. Since the adjoint (time-reversed) process 
of our PDMP is again a PDMP with reversed vector fields, the space on which it is natural 
to study the adjoint process and its limiting behavior is 



# = {W*)'X(*)} te[ o,T] e C([0,T],n) x -M ([0,T]) r 



Xa(t) = 1 a.e., x(t) = x - J ^2xa(s)Fa(x(s))ds} . (6.15) 



For models having invariant measure of the form (|5.ip . the rates r + of the adjoint process 
do not depend on A so that a LDP for the adjoint process can be obtained using again the 
results of |12|: 



x ,cr 



where 



*(*)>x(*)} te[ o,T] « {m,m} te[0 , T] ) ~ e "J.I^Uti) , (6.16) 
J^ T] {{x(t),x(t)} te[0T] ) := ! j + (x(t), X (t))dt. 



3 + {x,x)-= sup ^2 Xar + (a,a'\x) 



J 

Zrr 



(6-17) 
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In the above formula Px^o is the probability measure on y£ induced by the adjoint 
process with parameter A and initial condition (xo,co)- Remember that in this case the 
rates r + in (|6.17p are related to the rates r of the direct model from (15.2|) . 

Let us assume now, as done for (16 .9p . that for all x G O the chemical part L c [x] of the 
direct generator is reversible w.r.t. the quasistationary measure fJ>(-\x). Then we know 
that the same property holds for the adjoint process with n(-\x) replaced by /x + (-|x). In 
this case, similarly to (j6.9l) . we get 



j + (x,x) = Y / l + (<r\x)Xv- Y\ / r+(a, <t'\x)^^& . (6.18) 

a (a,a')eW V ^ ^ 

Recalling relations (15. 2D and (15, 3D we obtain that 




j + {x,x) = ^2l + (o-\x)Xa ~ Y] \j ^j a }n\ r ( <T i°'\ x )\^Vx^> ■ ( 6 - 19 ) 



n(a'\x) 



As the reader can check, the proof of the LDP in [p2] remains valid for PDMPs 
with A-dependent rates r(a, a', X\x) obtained as perturbation of A-independent rates, i.e. 
r(a, a', X\x) = r(a, a'\x)(l + o(l)). Hence, the above result (|6.16p can be extended to 
more general processes with invariant measures not of the form (|5.ip . We will discuss an 
example in the next section. 

Let us now consider the LD rate functional J^'^ ■ C([0, T],fi) — > [0, oo] for the evolu- 
tion of the mechanical state in the adjoint process (dropping the above the reversibility 
assumption). It has the form 

r m '+ f/wm \ - \ !o ^{x{t),x{t))dt if x(-) e yZ' + , (a 9n , 

J [0 , T] ({x(t)\ tmT] ) - j +oo otherwige (6.20) 

where, similarly to y™, the space y™ ' + is defined as the mechanical projection of 3^,) 
while the the density j+(x,x) is given by 

j+{x,x)= inf j + {x,x)- (6.21) 

\X- x=-Y.aX<yF a {x)} 

In the above formula, x varies among the vectors in [0, l] r such that ^2 a X(r = 1- 

If the collection of vectors {Fa(x)} a£r are the vertices of a simplex for any then 
this holds also for the vectors {— F a (x)} aer and consequently we have 

x) = I J(x ' X ' F{±)) [iieC «- F <^) W) , (6 22) 

I +CXD otherwise . 

Trivially, C({-F a (x)} aeT )= -C({F a (x)} aeT ) and X ~ F {x) = X F (-x). 

7. Fluctuation theory 

In this section we further investigate the fluctuations of the mechanical variables of 
our PDMPs, following ideas and results developed in [lj [2l [3j H] for interacting particle 
systems and inspired by the Freidlin and Wentzell theory p3] for diffusion processes. As 
we will show, PDMPs are a natural source of examples where the macroscopic fluctuation 
theory developed in [U El El Sj applies. A key identity in this theory is given by the 
Fluctuation-Dissipation (FD) relation (|7.9p . which in [2] is a direct consequence of the 
Markov property, while the mechanical evolution of our PDMPs is not Markov. Hence, 



PIECEWISE DETERMINISTIC MARKOV PROCESSES 



29 



the FD relation cannot be taken for granted in our case. In Subsection 17.21 we will prove it 
for the class of exactly solvable PDMPs with stationary measure given by (15. ip as well for 
PDMPs on the Id torus not satisfying (|5.ip . Before considering these cases, in Subsection 
17.11 we reformulate the results of [U El EJ 0] , in the simpler context of processes with 
trajectories in C([0,T],f2) and discuss consequences of the FD relation (|7.9p . 



7.1. General framework. We consider a A-parameterized family of stochastic Markov 
processes with trajectories in C([0,T],Q), satisfying a sample path LD principle as the 
parameter A diverges to +oo. This means that, fixed {x(t)}t£[o,T] £ C([0,T],Q,), it holds 

< (M*)}* e [0,T] « {Ht)} te[0>T] ) ~ e - A/ [o T ] ({ £ W}- [ o,T 1 ) i (71) 

where in the above formula {x(t)} t£ ^ 0T j denotes a generic element of C([0, T],f2) and 
P:£ denotes the law on C([0, T],0) induced by the A-parameterized process with initial 
configuration xo € As a prototype one can take diffusions on Q = M. d with noise of 
order v/l/A as in the Freidlin and Wentzell theory |14j . 

We further assume that for any fixed A the A-parameterized process admits a unique 
invariant measure p\. Then the adjoint process can be defined and has p\ as unique in- 
variant measure. We assume that also the A-parameterized family of adjoint processes 
satisfies a LD principle as A diverges, i.e. (|7.ip remains valid with P^ and i^° T i re- 
placed by Pxq + and If^lm, respectively. In addition, we assume that there exist densities 
C(x, x), C + (x, x) : f2 x — > [0, oo) such that for any initial configuration xq the rate 
functionals I^ T ^ and admit an integral representation of the form 

' J T £(x(t),x(t))dt if x(-) G X XQ , 
+oo otherwise , (7-2) 



V] lW)^[o,T]J - j +oo otherw . se ^ (7.3) 

for suitable subspaces X Xo ,X+ Q C C([0,r],fi). This assumption implies in particular that 
all paths in X XQ and X£ starts in xo- 

The functions C and £ + are called Lagrangians. Typically, C(x, x) = if and only if 
x = F(x) for a suitable vector field F(x) that identifies the law of large numbers of the 
model in the limit of diverging A. In fact, in this case, from (|7.ip we can immediately 
derive that 

lim P* ( sup \x(t) - x(t)\ > 6) = , > , (7.4) 

where {i(i)} te [ T] G C([0> T],fi) solves the Cauchy problem 

= F(5(t)) , . , 

x(0)=x . [7 - b) 

Similarly we require that C + vanishes along a path {x(t)} t€ [ T j if and only if x(t) = 
F + (x(t)), where the vector field F + identifies the law of large numbers of the adjoint 
process in the limit of diverging A. 

Finally we assume that the family of invariant measures p\ satisfy a LD principle on Q 
as A diverges, with rate function V(x). This means that for any fixed t and for any fixed 
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x E ft it holds 

¥ x px (x(t) « x) ~ e" Al/ W , (7.6) 

where P^ A denotes the law of the stationary process with parameter A and initial distri- 
bution p\. Below we will denote by IPp^ + the law of its adjoint process. 

Let us now derive some consequences from our assumptions. By definition we have for 
any path x(-) E C([-T,T],ft) that 

P P, ({X(jt)}te[-T,T\ « M*)}t e [-T,T]) =lPp; + (W)}t e [-T,T] « {^(-*)} t6 [-T,T]) • (7-7) 

Due to the fact that the processes are Markov and that the path {x(t— T)} t ^ 2 T] belongs to 
the path space X x (-t) (referred to the time interval [0, 2T]), while the path {x(T— i)}t e [o,2T] 
belongs to the path space ^(t) (referred to the time interval [0, 2T]), (|7.7p implies the 
following relation concerning the LD rate functionals: 



V(x{-T)) + J C(x(t),x{t))dt = V(x(T)) + J 



C + {x{-t),-±(-t))dt. (7.8) 

T 

Dividing both sides of (17. 8p by 2T and taking the limit T { we obtain FD relation 

£(x,x) = W(x) -x + £ + (x,-x), (7.9) 

valid for any x,x corresponding to the values x(0), x(0) for some path x(-) as above. 

From now on we suppose that the FD relation (17. 9p holds, without assuming that the 
processes under consideration are Markov. Following pj we derive some consequences of 

{73}. 

A point x* E ft is called equilibrium point for the A-parameterized family of processes 
if F(x*) = 0. Then, by the LLN (|7.4[) . the trajectory x(t) = x* is the limiting path for the 
process starting in a;*, thus implying that If *j^(x(-)) = 0, i.e. £(x*,0) = 0. By means of 

the FD relation we obtain that C + (x* , 0) = and consequently x* is an equilibrium point 
also for the family of adjoint processes, i.e. we have F + (x*) = 0. We restrict now to the 
case that the vector field F has a unique equilibrium point x*, which is a global attractor. 
This means that 

lim x(t) = x* 

t— »+oo 

for any {x(t)} tg [ +oc ) solving x = F(x). Note that, due to the previous argument, x* is 
also the unique equilibrium point of the vector field F + . We assume that it is also a global 
attractor for F + . As simple example satisfying all the above assumptions, consider the 
family of reversible diffusions on ft = M. d descried by the SDE 

x = — Vf7 (x) + X~^w , 
where U is a single well potential and w is a standard Brownian motion. In this case 

C(x, x) = £ + (x, x) = — \x ■ + VU (x)| 2 , 

and V(x) = 2U(x). 

Let us introduce the quasi-potential Q{x) as function on ft defined by 

Q(x)=mi( C(x(t),±(t))dt, (7.10) 

Ax J — oo 
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where 

Ax = { {^(0} te (-oo,o] : = x » jj™^) = x *} • 

In the case of multiple equilibrium points and different basins of attraction the definition 
has to be suitably modified. We will not consider this situation here, referring to |14j the 
interested reader. 

Remark 1. We point out that the rigorous definition of quasi-potential is slightly different 
from (|7.1Up . Indeed, since the dynamic LD principles with rate functionals (|7.2|) . (|7.3|) 
hold for finite time intervals, one has to define the quasi-potential as 

Q(x) = inf inf f C(x(t),x(t)) dt , (7.11) 
T^OAE J-T 

where 

Ax={ {x(t)} te[ _ T0] : a?(0) = x , x(-T) = x*j . 

We use definition (17.101) to simplify our discussion, while the interested reader can adapt 
our arguments in order to obtain rigorous proofs (see for example (5jj. 

We now derive an H -Theorem for the quasi-potential. More precisely, we show that the 
quasi-potential is a decreasing Lyapunov functional for both the vector field F and for the 
vector field F + . This means that t — > Q(x(t)) is a decreasing function if x(t) = F(x(t)) or 
if x(t) = F + (x(t)), respectively. In order to justify our claim, we take a path {x(t)} t 
such that x(t) = F(x(t)). Let x = x(0) and x' = x(t'), with t' > 0. Given e > we fix an 
element {^(i)}f g [_oo o] 6 A x such that Q(x) differs from J(_ OQ) o](x(«)) at most e. Then we 
construct the following element of A x i 



x(t) 



x(t + t') if t < - 1' , 
x{t + f) ifte(-t',0] 

Since C(x(t),x(t)) = for all t ^ 0, we have 



Q(x') ^ f £(x(t),x(t))dt= f C(x(t + t'),x(t + t'))dt+ 

/ £(x(t + t'),x(t + t'))dt = C(x(t),x(t)) dt < Q(x) + e . 

J—t' J -oo 

By the arbitrariness of e, we deduce that Q(x') ^ Q{x). Therefore, it must be VQ(x) • 
F(x) ^ for all The same kind of argument can be used for the vector fields F + , 

thus implying that VQ(x) ■ F + (x) ^ 0. 

Let us now show that the quasi-potential Q(x) coincides with the LD rate functional 
V(x) of the invariant measures py. 

Q{x) = V(x) VxGO. 

Since C + is nonnegative, using the FD relation we get for any {^(0}te[-oo o] e A x that 

£(x(t),x(t))dt^ / VV(x(t))-x(t)dt = V(x)-V(x*) = V(x). (7.12) 



The last equality follows from the fact that the rate functional V is zero on the unique 
equilibrium point x*. The function V is in fact non negative due to the fact that it is 
a rate functional and it is zero in correspondence of x* that corresponds to the typical 
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value (law of large numbers). Due to the definition of the quasi-potential Q, the above 
bound (17.120 implies that Q(x) ^ V(x). In order to prove the reversed inequality, let 
{x + (t)} te ^ Q +QO ] be the solution of the Chauchy problem 

x+(t) = F+(x+(t)), 
x + (0) = x . 

Due to the global attractiveness of x* we have 



(7.13) 



lim x~ 



'(*) 



X ,1; 



so that T 



{x + (— i)lte[-oo o] e an( ^' D y definition of Q(x) and due 



to the FD relation (fT5]> . 

Q(x) ^ 



C(x + (-t), -± + (-t)) dt = V(x) , 

3 

thus concluding the proof that Q(x) = V(x). Coming back to the above expression, we 
then conclude that the path {x + (—t)} te ^_ OQ i is the minimizer in (j7.10j) . Hence, we arrive 
at the following key observation. Starting from equilibrium at time zero, for A and T 
large, if the system at time T is in state x then with high probability its evolution for 
times t £ [0, T] is well approximated by the path x + (T — •), where x + (-) solves (|7.13p . 
More precisely: 



lim lim 

TToo AToo 



PA 



{*(*)} 



te[o,T] 



lim lim 

T]oo AToo 



{x + {T-t)} 



te[o,T] 



x(T) 



x 



PA 



({s(*)}te[-T,o] ~ i x+ (-t)}te[-T,o] x(0) 



1. (7.14) 



We call {x + (— i)}tg[o,oo] the exit trajectory, while we call the path {x(t)} te [ 0i +oo] solving 
(|7,5h the relax trajectory (motivated by the LLN). When the vector fields F and F + 
coincide, i.e. 

F(x) = F + (x), VxeH, (7.15) 
then the exit /relax trajectories are related by time reversal and using the terminology of 
PP, [2] we say that an Onsager-Machlup symmetry holds. When condition (|7.15p does not 
hold, the exit/relax trajectories are not necessarily related by time reversal and according 
to [I], [2] we say that a generalized Onsager-Machlup symmetry holds. 

We conclude this subsection justifying the name "Lagrangian" given to C(x,x). From 
classical arguments in variational analysis it follows that the quasi-potential Q(x) as de- 
fined in (|7.10p solves the Hamilton-Jacobi equation 

H{x,VQ(x)) = 0, (7.16) 

where the Hamiltonian H is obtained as Legendre transform of C as 

H(x,p) = sup (p-y-£(x,y)) . (7.17) 



It can be shown (see [2] for details) that Q is the maximal solution of (|7.16p . The r.h.s. of 
(|7.16p must be zero for the following reason. Due to (|7.17p it must be H(x*,0) = 0, while 
due to the fact that Q(x) ^ Q(x*) it must be VQ(x*) = 0. Hence, Tt(x*, VQ(x*)) = 0. 

Clearly the above arguments hold also for the family of adjoint processes. In particular, 
the quasi-potential Q solves also Hamilton-Jacobi equation 

n + (x,VQ{x)) = 0, (7.18) 
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where the Hamiltonian 7i + is obtained as Legendre transform of C + as 

H + (x,p) = sup (p-y-C+(x,y)) . (7.19) 

Note that due to the validity of the FD relation (17. 9h we have 
H(x,p) = sup (p-y- C(x,y)) 

= sup (p ■ y — W(x) • y — C + (x, —y)) 

y£K d 

= sup ((W(x) - p)-y- C + {x, y)) = H + (x, W(x) - p) . 

7.2. Application to PDMPs. In this subsection we further analyze the fluctuations of 
the process x{t) describing the evolution of the mechanical state in our PDMPs, according 
to the results just described. As already stressed, the theory described in the previous 
subsection is based on the FD relation (|7.9f) . which is always true if the process under 
consideration is Markov. In the case of PDMPs, the Markov property of x{t) is typically 
violated. We check here the validity of the FD relation for a large class of PDMPs. That 
automatically implies the discussion following (17. 9p . 

7.2.1. PDMPs with invariant measure of the form (|5.1[) , Let us first restrict to PDMPs 
with invariant measure of the form (|5.ip . for which we can apply the results of Section 
also to the adjoint process. The vector fields F and F + mentioned in the previous 
subsection become 

/ F[x)=Y,„n{p\x)F a {x), 

\ F+(x) = -^ a ^(a\x)F a (x). 

We recall that p(-\x) and p + {-\x) are the unique invariant measures of L c [x] and 
respectively. 

We already stressed that the mechanical process is in general not Markovian and con- 
sequently there is not a natural notion of invariant measure. This has to be replaced by 
the projection p\ on the x component of the invariant measure of the joint mechanical 
and chemical Markov process 

P\{x) :=^2p\(x,a) . 

In this case it is easy to compute the limit lim^oo A -1 logp^(a;), and derive a LD principle 
for p. To this aim, first observe that the function S in (15. ip is univocally determined up to 
an additive constant. From now on, we denote by S the unique function satisfying (15.11) 
normalized in such a way that inf xg Q S(x) = 0. By this choice, it is simple to see that 

lim A -1 log p\(x) = —S(x). 

A— >oo 

Comparing with (|7.6|) . we deduce that S(x) = V(x), namely the function S coincides with 
the LD rate functional of the measures p\ . 

We now establish for this class of models the symmetry relation 

j{x, X) ~ X) = Xu h( a \ x ) ~ 1 + ( a \ x )) i ( 7 - 20 ) 

(7 

for the joint rate density j and y introduced in[6l 
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When L c [x] and consequently also Lj" [x] are reversible w.r.t. the corresponding qua- 
sistationary measures, then (|7.20p follows directly from the explicit expressions (I6.9() and 
()6.19p . In the general case we can write the variational expressions (|6.7p and (|6.17p as 



j(x,x) =y2Xal(v\x) - inf V Xar(cr,a'\x)— , (7.21) 

j + (x, X ) = J2xal + (a\x)- inf ( £ X M°, a>\x) 1 ■ (7.22) 

When Xo- > for any <7 G T we introduce z a := -njrzxz ■ The variational expression in 
(|7.22p can then be written as 



Ie(0 ' +oo)r \(^ew Z ° J 

that coincides with the variational expression in (|7.21|) . Relation (|7.2U|) now follows im- 
mediately. The same result can be obtained also in the case that there exists some a G T 
for which Xa = 0. We discuss this case in Appendix [Dl 

Using equations (|5.9p (valid for each a G T), which are equivalent to the second group 
of equations in (|5.7p . we obtain that (|7.20p can be written as 



j(x,x) ~ 3 + { x 



,X) = VS(x)- h^XaFaj ■ (7.23) 



Observe that to compute both j m (x, x) and j^x, —x) we need to minimize respectively j 
and j + over X subject to the same constraint 

|^ Xs F CT (z)=zJ . (7.24) 

Recalling ()7.23j) . we get for any fixed x and x that 

j m {x,x) = inf j{x,x) 

{X- T,sXsFa(x)=x\ 

= VS(x)-x+ inf j + {x,x) 

{x- T.sXsFct(x)=±} 

= VS{x)-x + j+(x,-x). (7.25) 

That corresponds to the FD relation (|7.9p since, as already observed, S(x) = V{x). From 
(I7.25P we obtain also that the minimizers in (|7.24p for the computation of both j m (x,x) 
and jm( x i ~ x )i coincide. We point out that in the case of computable LD rate functionals 
as in (|fTlIj) and (|fT22|h identity (^25|) follows directly from ([62]), flgZED and the simple 
relation X „(x) = Xa (-&). 

It is interesting to note that we can obtain a simple explicit expression for the entropy 
production, i.e. the rate of variation of S along the orbits of the vector fields F and F + . 
Given x(t) a solution of (|7.5p . using (|5.9p we have 

VS{x) • x = VS{x) ■ F(x) = n(a\x)VS{x) • F a (x) = ^ n(a\x) {^{a\x) - 7 + (<r|x)) . 

CT cr 

(7.26) 
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Likewise given x + a solution of (|7.13p we have 

VS(x + ) ■ x + = V + {°\ x+ ) {l + {o\x + ) - l{o\x + )) . (7.27) 



We now illustrate with examples the validity of the general results discussed in sub- 
section 17.11 for PDMPs. We stress that these results are a direct consequence of the FD 
relation (|7.9p checked above. We first consider the ID models of Subsection 14.11 In this 
case the quasistationary measures for the direct and adjoint chemical generators can be 
easily computed and we have 

p( T ) - r(l,0|s) p ,, s r(0,l\x) p / s 

r(lfl\x)F$(x) t? („\ i r{Q,\\x)F*(x) „ , n\ l'^ 8 J 



\ > \r(l,0\x)Fg(x)+r(0,l\x)F?(x) rl{ - ^ > " r r(l,0|x)F 2 (x)+r(0,l|^)^ 1 2 (^) 01 ^ 

Note that x G SI is an equilibrium point for F if and only if 

r(l,0|x)F (x) +r(0,l|x)Fi(x) = 0. 

The same equation characterizes the equilibrium points of F + , thus implying that F and 
F + have the same equilibrium points in £1. Moreover we have that both relations F(x) > 
and F + (x) > holds if and only if 

r(l,0|x)F (x) +r(0,l|x)Fi(x) > 0, 

so that also the stability of the equilibrium points for both vector fields is the same. We 
point out that, since i*b(a) = Fi(b) = 0, the adjoint vector field F + has two additional 
equilibrium points at the boundary dfl = {a, b}, which are necessary unstable. 

Note that there are models such that the vector field F has many stable equilibrium 
points. In this case the definition of the quasi-potential Q(x) in (|7.1U|) has to be modified 
considering separately the different basin of attraction. We do not discuss this possibility. 

For a vector x G C {Fq(x), Fi(x)} we have that 

F r -\ Fi{x)-x F x-F (x) 



Fi(x)-F (x) ' Ai w F 1 (x)-F (x) 
Using the results of section [6] (see ()6.10p and (|6.14p ). we get 



, l r(0,l\x)(F 1 (x)-±) r(l,0|x)(x-F (x)) \ 

^ x > x >-[\l Fi(x)-F (x) V *i(*)--Pb(x) ) { ] 

for all x G $7 and x G C(Fo(x), Fi(x)). Since similarly to (|6.10p + (|6.14p it holds 

j+(x,x) = (j X o F (x)r+(0,l\x) - yJxT F (*)r + (l,0\x)) , (7-30) 
observing that X~ F ( X ) = X F (~ X ) f° r an x £ C( — F)(x), — Fl(x)) we conclude that 

/ r(l,0|x)|F (x)|(F 1 (x)+x) / r(0, l|x)F (x)(-x - F (x)) \ * 
Jml ' j \j ^i(^)(^i(^)-^o(x)) V |F (x)|(F 1 (x)-Fo(x)) J ^ 

for all x G and x G C(— Fo(x), —F\(x)). The validity of the FD relation (|7,9p can now 
be checked directly recalling that in this case 
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Also the validity of the H-Theorem can be checked directly, we have in fact 



r(0,l|x) +r(l,0\x) 
and 

(r(0,l\x)Fx(x) +r(l,0\x)F o (x) 

VS(x) ■ F + (x) = 



r(0,l|x)F 2 (x) +r(l,0|x)F 2 (x) ' 
whose negativity is immediate. Finally we can also explicitly compute the Hamiltonian 

H(x,p) = sup [py-jm(x,y)] , 

yec{F (x),F 1 (x)} 

and check that (|7.32|) is its maximal solution. The solution to this variational problem is 
given by 

H{x,p) = px(x,p) - j m (x,x(x,p)) , 

where 

x(x,p) = + F (x)) + i(Fi(x) - F (x)), I 



and 

e(x v)= ((F(x)-F n (x)) P _ r(0,l\x)-r(l,0\x) \ 2 

V y/r(0,l\x)r(l,0)\x) y/r(l,0\x)r(0,l\x) J 

It can be checked that the Hamilton-Jacobi equation TC(x,'VS) = holds. We refer the 
reader to pjj] for these computations and for more details on the one dimensional models 
on a bounded domain. 



In the case of the triangular domain with unitary jump rates discussed in subsection 
15.21 we have 

F(x,y) = (k~ x '\~y 

and 

F+{X ' V) = { X ~ x 2 + y 2 + (l-x-y) 2 ' y " x 2 + y 2 + (l-x- 2/ ) 2 ) ' (7 ' 33) 

The vector field F has an unique stable equilibrium point (3,3) £ fi, which is globally 
attractive. The vector field F + has |) as unique stable equilibrium point in which 
is globally attractive for all other points of 0. Moreover F + has also unstable equilibrium 
points belonging to dQ. These are given by (0,0), (0,^), (0,1), (^,0), (1,0) and (5,5). 

The validity of the H-Theorem can be checked directly recalling the expression (15.401) 
and computing 



VS(x,y)-F(x,y) = 




The above expression is negative due to the fact - + - + - 9 when x. y and z are 

x y z 

constrained to satisfy the relation x + y + z = 1 (this follows from the convexity of 
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x — ► 1/x). We can also compute 

VS(x,y) ■ F + (x,y) = — — ^—k \2 ~ 3 

x z + y z + (1 — x — y) z 

that is negative due to the fact that X ,a + Ja +Z a ^ 3 when x, y and z are constrained to 
satisfy the relation x + y + z = 1 (again by convexity). 

Finally, we point out that our general considerations allow to solve non trivial variational 
problems. Consider for example the problem to determine the infimum 

inf f° (2- VxAt)Vx^(t))dt, (7.34) 

(x - y) J -°° (*,*>)ew 

where A.i x ,y) denotes the family of continuous paths z(t) : (— 00, 0] — > M 2 , such that 
(i) limtj-oo z(t) = (1/3,1/3), (ii) z(0) = (x,y), (hi) z(t) belongs to the convex hull 
C {F%(z(t)), i<2(z(t)), F3(z(t))}, while (xi(i), X2(t), X3(*)) denotes the unique probability 
measure such that z{t) = Y%=\Xa{t)F a {z{t)). This last identity is equivalent to the 
system 

X i(t) = l-x(t)-y(t)-x(t)-y(t), 
Xz(t) = x(t) + x(t) , 
Xs(t) =y(t)+y{t). 

Since the integrand in (|7,34p is the LD functional density j(x(t),x(t)) (cf. (|6.9p ). while 
(1/3, 1/3) is the equilibrium point of the vector field F, we know that the minimal value 
in (|7.34p is given by the quantity S(x,y) in (|5.40p . after suitable renormalization. More 
precisely, the solution of (|7.34p equals 

— log x — log y — log(l — x — y) — 3 log 3 . 

Moreover, the minimizer in (|7.34p is obtained by time-inversion of the solution of the 
Chauchy problem 

(x(t),y(t)) = F+(x(t),y(t)), 
(x(0),y(0)) = (x,y), 

where the vector field F + is computed in (I7.33p . 

7.2.2. Generalizations of identity (|7.25p . As already observed, the validity of the FD rela- 
tion for PDMPs with invariant measures of the form (|5,ip follows from the identity (|7.25p . 
This key identity can be rewritten as 

j m (x,x) = VW ■ x + G(x,-x) , (7.35) 

where W = S and G(x, — x) = j+(x,— x). In this subsection, we desire to present a 
conjecture related to (|7.35p . In general, the computation of the quasi-potential (|7.10p for 
PDMPs not having invariant measure of the form (|5,ip is non trivial. We will discuss a 
specific example of this type in the next subsection. A possible purely variational approach 
to this problem is as follows. Suppose we can decompose the dynamic LD rate density as 
in (|7.35p . where now Q(x, x) is a nonnegative function, which is zero only when x = G(x), 
with G a vector field having x* has the unique global attractive equilibrium point. Then 
from the general arguments in subsection 17.11 we have that W coincides in fact with the 
quasi-potential Q. Inspired by the structure of the rate functionals for PDMPs we can 
search for Q having a specific form. For simplicity we discuss only the case of computable 
rates of the form (|6.14p when the chemical part of the generator is reversible for any x 
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and consequently j is given by (j6.9H . In this case given a positive tp(a,x) we can search 
for a Q of the form 

Q{x,x) = J2^f( a \ x )Xa F (x) ~ Yl \ uta^x) ^ a '\ X ^ X ^ F ^^J X^ F ( A ) ■ 

° (a,a')eW V ^ 1 ' 



(<T,Cr') 

where 



7(a|xj := yr{a ,cr\x)- 



To verify (|7.35|) we need to find a function such that for any x, x it holds 

^ ( 7 (<7|s) - 7(a|x)) (i) = • i = ^ (VW ■ F a {x)) x£{±) . (7.36) 

a cr 

To derive the above condition we used X F {%) = Xa F (~ Condition (|7.36[) is verified if 
and only if for any a S T and for any x E we have that j(o~\x) —^f(a\x) is the directional 
derivative of W at x along the direction F CT (x) . In this case the vector field G is given by 

where Z(x) := ^fe^ . If we can find the positive functions ip in such a way that the 
above requirements are satisfied then the function W obtained in (|7.36p . appropriately 
normalized, coincides with the quasi-potential. In this case we obtain also that F + in fact 
coincides with G. We do not discuss this issue here. 

7.2.3. PDMPs on the ID torus. We now consider the PDMPs with 0, = R/Z discussed 
in Section 14.21 If the equilibrium condition (|4.9I) holds, then we know that the invariant 
measure has the form ()5.ip and therefore the validity of relation (|7.9f) follows from the 
above discussion. We consider here the general case, without assuming (|4.9p . 

Starting from the exact expression (|4.6I) of the invariant measure we can derive the LD 
functional of p\. We have that 



lim p\(x) = lim A log p\(x, 0) + p\(x, 1] 

A— »oo A^oo 



sup 

y£[x,x-i-l 



(s(y)-S(x))+c=:-W( L x), (7.37) 



where c is an appropriate additive constant related to the normalization factor k = k(X) 
in (|4.6|) . Formula (|7.37p follows from the fact that for arbitrary a(A) and 6(A) it holds 

lim A -1 log (a(A) + b(X)) = max{ lim A -1 loga(A), lim A -1 log 6(A)} , 

A^+oo A^+oo A^+oo 

and from the Laplace theorem Note that the function W defined in (|7.37p . due to 
the validity of (|4.7p . satisfy the periodicity condition W(x) = W(x + 1) and consequently 
it can be interpreted as a function on the torus f2 = R/Z. The constant c appearing in 
(|7.37p can be computed observing that, since J n p\(x)dx = 1, the Laplace theorem implies 
that infj-g^i] W{x) = 0. Therefore, it must be 



sup sup ( S(y) — S(x) 

x£[0,l] ye[x,x+l] 
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The above function W is the LD functional for the measure p\. If the function S is 
periodic, then it is simple to check that W(x) = S(x) — minimi] S(y). In the general 
case, W is a nonnegative function that can be flat on subregions of 0. 

Let us now verify the validity of the FD relation (|7.9p . with i2(x,x) — j m {x,x), 
C + (x,x) = j+(x,x) and V = W. For simplicity, we assume the same conditions dis- 
cussed after (|4.13|) . The function y(x) is defined as in the paragraph below (|4,13|) . First 
we need to compute VW. We have that in the points where W is differentiable it holds 

VW(x) = VS(x) - VS(y{x))X7y(x) . (7.38) 

When y(x) G (x, x + 1) we have that (I7.38|) becomes 

VW(x) = VS(x) , (7.39) 

due to the fact that VS(y(x)) = 0. When y(x) G {x, x + 1} then (|7.38p becomes 

W(x) = 0, (7.40) 

due to the fact that VS(x) = VS'(x + 1) and Vy(x) = 1. Note that this second alternative 
holds for any x if the vector fields Fq and F\ have the same sign so that in this case W is 
identically zero. 

The lag rangian jVra(x, x) can be computed by means of (|6.10p and (|6.14p . getting that its 
expression coincides with (I7.29p . The lagrangian j+(x,x) can be computed by adapting 
the arguments in |12j . We get that its expression can be obtained from (I7.30P where 
instead of the A-dependent rates r + we have to use their asymptotic limit value given by 
KWi . We obtain for all x 6 and x £ C(-F (x), -Fi(x)) 

■+, - A _l l r(l,0\x)B(x)(F 1 (x)+x) I r(0, l\x)(x + F^xfi V 
Jm{,) \\j F 1 (x)-F (x) \j B(x)(F (x) - F 1 (x)) ) ' U ' 4ij 

where B(x) — ^I&i|gfeM^ 

We can now compute j m (x, x) — jmi x i ~%) obtaining 

r(l,0|x)fl + B(x)) - r(0, l|x)(l + B _1 (x 



F 1 (x)-F Q (x) 

r(0, l|x)(Fi(x) + F (x)B- 1 (x)) - r(l, 0|x) ( F (x) + Fi(x)B(x] 



F 1 (x)-F (x) * (7,42) 

The validity of the FD relation for points x where W is differentiable follows now directly 
from the fact that if y(x) G {x, x + 1} then B{x) = f7j^jfj ; while if y(x) G (x, x + 1) then 

B[x) = — (recall l4*.16p . In particular the second term in f|T.42|> is identically zero. 

Finally we point out that in the general case the quasi-potential cannot be defined 
directly as in (|7.10p . Indeed, the hypothesis of existence, uniqueness and global attrac- 
tiveness of the equilibrium point of F could be violated. We cannot then identify directly 
W with the quasi-potential. 

8. A Gallavotti-Cohen-type symmetry 

In this section we briefly discuss a Gallavotti-Cohen-type (G-C) symmetry for PDMPs. 
Let us briefly recall a result of [1.7]. Consider an involution 1Z on the path space of a 
stochastic process, i.e. a map from the path space into itself such that 1Z 2 = 1. Assume 
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also that the measure P s t oTZ 1 is absolutely continuous w.r.t. F s t, where ¥ s t denotes the 
stationary measure of the process. Then the random variable 



Wt := — ™ lof 



(8.1) 

t£[-T,T] 



2T ° dF st 
satisfies the G-C-type symmetry 

E st (e- sWT )=E st (e-^ WT ) , (8.2) 

where E s t denotes the expectation w.r.t. P s j. 

Differently from the examples discussed in [T7], for PDMPs it is natural to consider 
involutions 1Z different from time reversal. Indeed, take a trajectory {x(t), c(i)} tg [_ TT ] of 
the PDMP, i.e. an element of C([—T,T],Q) x D([—T,T],T) such that for any continuity 
point t G [— T, T] of { a (t)} te [_ TT j it holds 

x(t) = F a(t) (x(t)) . (8.3) 

Then, the time reversed trajectory T[{x(t),cr(t)} t ^_ TT ^ = {x(— t), a(— f)} (e j_ TT ] is 
typically not a trajectory of the PDMP due to the fact that if the vector fields F a are 
not identically zero then condition (|8.3jl is violated. In the case of PDMPs the absolutely 
continuous condition is equivalent to the preservation of relation (|8,3|) . This means that 
for any trajectory \x(t), a ('t)} te ^_ T T ^ a ^ so T^[{x(t), c(t)} tg [_ T T j] has to satisfy condition 
(|8.3p . We need then to find an involution TZ on the path space preserving relation (|8.3p . 

This is easily done for the following class of models. Consider a PDMP such that for 
any a 6 V and for any x 6 SI there exists a unique a' E V such that F a /(x) = —F a (x). We 
call R x the involution on V that associates to every a the corresponding a' characterized 
as above. Then the map TZ defined as 

n[{x(t),a(t)} tE[ _ TT] \ := {x(-t),R x{ _ t) a(-t)} te[ _ TT] (8.4) 



is an involution on the path space preserving (|8.3p . An example of such a PDMP is given 
by O = M 2 /Z 2 , T = {1,2,3,4} and vector fields Fi = a, where e\ and e2 constitute the 
canonical basis of M 2 and e% = —e±, e\ = —e2- Then 7Z x l = 3, TZ X 2 = 4, TZ X 3 = 1 and 
1ZA = 2. 

If we consider models satisfying additional assumptions we obtain an explicit form of 
the functional (|8.1|) having a direct physical interpretation. More precisely, we assume 
that the jump rates satisfy the generalized detailed balance condition 

r(<7, <t'\x) = ex.p{H(a, x) — H(a', x)}r(R x a' , R x a\x) , (8-5) 

for a suitable energy function H : V x Q — > R, and that the function 7(-|-) satisfies 

j(a\x) = j{R x a\x) , V(x,cr) G ft x V . (8.6) 

This happens for example if we define the rates as 

r(a, a'\x) := exp{ [H(a, x) - H(a', x)}/2) , (8.7) 

for an energy function H satisfying the symmetry condition 

H(a,x)=H(R x a,x), V(i,d)e!lxr. (8.8) 
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Assuming (|8.5p and (18.60 . it is easy to compute (|8.ip using standard methods for jump 
processes (see for example [IS])- O ne gets up to boundary terms 

WT = ^Ei^^r)^)) - #((7(7-0, S(7i))} • (8-9) 

i 

The boundary terms are due to the fact that in (18. ip we are considering stationary mea- 
sures. In the case of compact phase space fixT they are negligible in the limit of diverging 
T. In the above formula (|8.9p the sum is over the jump times r, of {cr(t)} t ^_ T T j and we 
denote the left limit as cr(t~) := lirriAj.o <?(t — A). Since for any trajectory it holds 

H(a(T),x(T)) - H(a(-T),x(-T)) = [ VH(a(s),x(s)) ■ x(s) ds 

J-T 

+ J2{H(a(n),x(r i ))-H(a(rn,x(r i ))} , 

i 

in the case of bounded energy functions H we can derive from (18. 9p that 

WT = ^rf T vf(ct(s) ' x(s)) " ds + o(1) ' (8 - 10) 

which is the averaged mechanical work done on the system by the external force fields V-ff, 
apart negligible errors as T f oo. Trivially, for PDMPs, (|8.10p coincides with 

WT = h\ T _ T Vif ( CT ( s )> • F *(s) (*(*)) ds + °(!) • ( 8 - n ) 

Appendix A. Extended generator 

We first recall the definition of the Markov generator of the PDMP. A bounded mea- 
surable function / : f2 x T — > R is said to belong to the domain T)(L) of L if the functions 

n x r 3 (x,a)^r x [l* ,(/(**, <r t )) - /(x,a)] (A.l) 

converge uniformly (i.e. w.r.t. the uniform norm || • ||oo) to a bounded measurable function 
g as i | 0. In this case, one sets Lf := g. 

As discussed in [TO] . if the jump rates r(<r, <t'|x) are not uniformly bounded, it is a 
difficult task to characterize exactly the domain T>(L) of the generator L. Moreover, 
P(L) could not contain very regular functions. Let us stress this last point by means 
of a simple example discussed in more detailed in Appendix [Bj We take = (0,1), 
r = {0,1}, F Q (x) = -1, F x (x) = 1, r(Q,l\x) = 1/x, r(l,0\x) = 1/(1 -x). The associated 
PDMP satisfies all our assumptions. Indeed, L c [x] has a unique invariant measure, the 
number of jumps in a finite interval is finite a.s. due to (|2,lip (see Appendix [B]), while 
the mechanical confinement in f2 is implied by (|2,14p . As discussed in Appendix [Bl the 
very regular function f(x,a) = a does not belong to the domain T>(L). 

On the other hand, by standard computations, it is simple to prove that if the rates are 
bounded (as in the case that O is the d-dimensional torus), then functions f(x,o~) which 
are bounded and C 1 in x belong to the domain T>{L) of the generator and and Lf equals 
(|2.7p . For general rates, the same computations allow to get the same conclusions for 
functions f(x,a) that are bounded, C 1 in x and with compact support inside £1. In order 
to have a unified treatment, it is convenient to work with a weaker definition of generator 
L introduced by Davis (see [9] , [TO] ) , which allows a simple characterization of the domain 
P(L) and is strong enough to develop stochastic calculus for PDMPs. From now on, L 
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will denote the extended generator, whose domain T>(L) is given by the set of measurable 
functions / : £1 x T — > R with the following property: there exists a measurable function 
h : $7 x r — > R such that the function f — > h(x(t),a(t)) is integrable P^ CT — a.s. for all 
(i,ff)£!lxr and the process 

C{ := /(x(t), <r(t)) - /(x(0), (7(0)) - / a( S ))ds 

J o 

is a local martingale. Then, one sets L/ := h. We have recalled here the definition of the 
extended generator for completeness, the reader non familiar with local martingales can 
skip it. We only use some consequences of the definition. In particular, we recall that L is 
an extension of the classical Markov generator, the domain T>(L) of the extended generator 
admits a simple characterization and it includes all bounded functions f{x,a) which are 
C 1 in x (see Theorem (26.14) and Remark (26.16) in [TO]). Moreover, for all functions / 
in V(L), Lf is given by (12. 7h . We point out that the theory in [TO] is developed under 
the assumption that for any starting point (x, a) the number Nt of jumps in the interval 
[0, t] has finite expectation. As already observed, this condition is implied for example by 
(12-TOD . 

Appendix B. An example of ID PDMP with singular features 

We consider the ID PDMP such that (1 = (0,1), T = {0,1}, F (x) = -1, F x {x) = 
1, r(0, l\x) = 1/x, r(l,0|x) = 1/(1 — x). This PDMP satisfies all our assumptions. 
Indeed, L c [x] has a unique invariant measure fi(-\x) given by (|2.9p . while the mechanical 
confinement in Q is implied by (|2.14p . Moreover, we claim that the number of jumps in a 
finite interval is finite a.s. due to (|2.1ip (note that (|2.10p is violated). To this aim suppose 
by contradiction that the family of jump times is a sequence converging to some r* < oo. 
Before time r* the mechanical state must be eventually in (0,3/4] or in [1/4, 1) (otherwise 
it should evolve with arbitrarily large velocity). Let us consider for example the first case. 
Then, the system must be infinite times in the chemical state a = 1 and, once it jumps 
into a = 1, it remains in this chemical state for a random time typically of order one. This 
is in contradiction with the fact that Tt+i — Tfc converges to zero. 

Let us now take A = 1 and show another special feature of our simple PDMP: the regular 
function f(x,a) = a does not belong to the domain of the classical (i.e. not extended) 
Markov generator. To this aim, let us start in the point (xo,0). Then, the r.h.s. of (jA.lj) 
is simply t _1 P^, (o"t = 1). If (jA.lh has to converge uniformly to a bounded function as 
t I 0, then it must be 

limsup sup t _1 P^ (<7t = 1) < oo . (B.l) 

tio a> e(o,i) 

It is simple to check that the above condition is violated, thus implying our claim. Indeed, 
Pj. o (<7j = 1) can be bounded from below by the probability that the process makes only 
one chemical jump in the time interval [0, t}. Therefore, taking xq < t, we get 

f' x ° t 
^ (a t = 1)> I 7(0|x - s ) e -/o 7(o|*o-«)**-;. j(i\x -s+v-s)dv ds = 

'( Xo _ s ) _:L e - fa(xo-u)~ 1 du-f*(l~x +2s-v)- 1 dv ( i s = 

1 ds^x, 1 (l-x + 2s-t)ds = l-t. (B.2) 

Jo 1-xq + s J 







■•'■<) 
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Therefore, the supremum over xq £ (0, 1) in the l.h.s. of (IB.lj) is at least (1 — t)/t. This 
implies that (|B.1[) is violated. 

Finally, we come back to the observations about the existence of the invariant measure 
collected in Section [3j We take (xq, <7o) &s initial state and write v t for the distribution at 
time t. By compactness arguments, we know that the sequence of probability measures 
Uf := t~ l f is s ds admits a subsequence weakly converging to a probability measure z/* on 
the closure Q x T. Let us show that z/# has support on 11 x T, thus implying that 
describes a steady state of the PDMP. Consider the interval I £ = (0,e), e < 1. When 
the mechanical state enters in the interval I e , the chemical state of the system must be 0. 
After a time of order O(e) the system jumps into the chemical state 1 keeping this value for 
a time 0{\). During this interval x(t) moves on the right with constant velocity, spending 
at most 0{e) time inside I £ . Hence, in a time interval of order 0(1) the mechanical state 
is in I £ for at most 0(e) time. This implies that v%{! £ xT) ^ ce, for each t. It is simple 
to conclude that the limiting measure must give zero weight to {0} x T. The same 
conclusion holds for the set {1} x T, thus proving that ^*({0, 1} X T) = 0. 



Appendix C. An example of ID PDMP with a finite number of jumps 

We take here Q = [0, 1] and T = {0, 1}. The vector fields are given by Fq(x) = —x and 
F\(x) = 1 — x and the jump rates by r(0, l\x) = x and r(l,0|x) = 1 — x. 

Let us consider the process with initial condition given by (x*,0), with x* a generic 
element of fi. We can easily compute the probability that there are no chemical jumps 

P^ %0) ( a {t) = 0, Vt G M+) = e- Xx * ^ + °° e ~ tdt = e ~ Xx * ^ e~ x . (C.l) 

A similar estimate can be obtained also if we consider the process starting from the 
chemical state 1. The above result (IC.ip states that every time the process jumps into a 
new chemical state a, with positive probability uniformly bounded from below by e~ A it 
will never more change its chemical state and consequently the mechanical variable will 
definitely evolve according to the ODE x = F a (x). As a consequence it is easy to derive 
that this PDMP has a.s. a finite number of jumps and that the invariant measures are of 
the form 

c6(x)5 afi + (1 - c)5(x - l)5 aA , c G [0, 1] . 



Appendix D. Derivation of (I7.20p in the general case 

We consider here the case that there exists some a G T for which \a = 0. For simplicity 
we assume Xai = an d Xo- > for any a ^ a\. The general case can be proved in the same 
way. Let us define r 1 := {a G T : a ^ ai} and W 1 := {(a, a') G W : a ^ ai, a' / <7i)}. 
We want to show that 

inf , Yl X*r(a,a'\x)— = inf V X*r((T, a'\x)— . (D.l) 

•6(0. W (u ^ ew *° ze(o, + ^r {a ^ m 

The r.h.s. of (|D.ip is clearly less or equal than the l.h.s. To prove the opposite inequality 
take z G (0,+oo) r and consider z e := (e, z) G (0,+oo) r . We have that 

lim Xar(cr,a'\x)-^- = ^ Xar(a,a'\x)— , 
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and this implies (ID. lh . This argument shows that we can write (I7.21|) and (|7.22)) as 

j( x ,x) = ^Xal{cr\x) - inf i ^ X^a, a'\x)— , (D.2) 

zG (o,+oo)r ((Tj(T , )gH/1 z ° 

3 + {x,X) =S >2x<t1 + {o\x) - inf V Xa'r(a,a'\x) p x,a Z(T , (D.3) 

If we introduce z a := *°^ z for any cr £ T 1 the variational expression in (|D.3|) can be 
written as 

inf V Xar^cr'lx)^ , 

which coincides with the variational expression in (|D.2[) . Relation ()7.20p now follows 
directly. 
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